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Abstract 

d ■ We investigate classical spin systems in > 1 dimensions whose transfer op- 

^ ! erator commutes with the action of a nonamenable unitary representation 

^1 of a symmetry group, here S0(1,A^); these systems may alternatively be 

IT^ I interpreted as systems of interacting quantum mechanical particles moving 

^ • on hyperbolic spaces. In sharp contrast to the analogous situation with a 



compact symmetry group the following results are found and proven: (i) 
Spontaneous symmetry breaking already takes place for finite spatial vol- 
ume/finitely many particles and even in dimensions d = 1, 2. The tuning of 
a coupling/temperature parameter cannot prevent the symmetry breaking, 
(ii) The systems have infinitely many non-invariant and non-normalizable 
generalized ground states, (iii) the linear space spanned by these ground 
states carries a distinguished unitary representation of S0(1, A^), the limit of 
the spherical principal series, (iv) The properties (i)-(iii) hold universally, 
irrespective of the details of the interaction. 
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1. Introduction 



Spontaneous symmetry breaking is typically discussed for compact internal or for abelian 
translational symmetries, see e.g. ^SIIIHIISZI- Both share the property of being amenable 
and their spontaneous breakdown is a specific dynamical property of the interaction. 
Here we consider systems with a nonamenable symmetry, by which we mean that the 
dynamics is invariant under a nonamenable unitary representation |3] of a locally com- 
pact group (which then by necessity is also nonamenable). One goal of this note is to 
show, roughly, that whenever the dynamics of a system of classical statistical mechanics 
is invariant under a nonamenable symmetry, this symmetry is always spontaneously bro- 
ken, irrespective of the details of the interaction. Neither does the long or short ranged 
nature of the interaction matter, nor can the tuning of a (temperature) parameter pre- 
vent the symmetry breaking. Spontaneous symmetry breaking even occurs in one and 
two dimensions, where for compact symmetries this is ruled out by the Mermin- Wagner 
theorem. The phenomenon is not limited to a semiclassical regime and occurs already 
for systems with finitely many degrees of freedom. 

The systems will be defined on a finite lattice A of arbitrary dimension and connectivity. 
The dynamical variables are 'spins' attached to the vertices of the lattice, taking values in 
some noncompact Riemannian symmetric space Q = G/K, where G is the noncompact 
symmetry group and K a maximally compact subgroup. The dynamics is specified 
by a transfer operator acting on the square integrable functions on the configuration 
manifold Q^. Such a system can alternatively be interpreted as a quantum mechanical 
system of finitely many particles living on Q; we only have to interpret the transfer 
matrix as exp{—H) and thereby define the Hamiltonian H; the inevitable spontaneous 
symmetry breaking appears then as degeneracy of the generalized ground states of this 
system. Conversely, given a quantum mechanical system with a Hamiltonian H, we can 
re- interpret the system as one of classical statistical mechanics with exp{—H) as the 
transfer matrix. To fix ideas one may take a Hamiltonian of the conventional form 



where Aj is the Laplace-Beltrami operator on Q for the i-th particle and the Vik are some 
potentials describing the interaction of particle i and k, depending only on the geodesic 
distances of the particles. Typically one would also require that the set A = {1, 2 ... i/} 
has the structure of a lattice and that the interaction links neighboring sites only. The 
Hamiltonians (jl.lj) are however only one class of examples, many others are covered. 
Indeed apart from some technical conditions on the transfer matrix it is mostly the 
invariance that matters. 

To analyze these systems, it is necessary to perform something analogous to the well- 
known separation of the center of mass motion from the relative motion in Euclidean 
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space. This turns out to be considerably more involved in our setting. It is convenient 
not to define an actual center of mass of the v spins or particles, respectively, but rather 
take simply one of them as parameterizing the global position of the configuration. The 
universality of the resulting symmetry breaking is then related to the fact that the 
global motion of these systems never allows for a symmetric (proper or generalized) 
ground state. 

Normally spontaneous symmetry breaking can only happen in the thermodynamic limit. 
We stress again that here the situation is different: spontaneous symmetry breaking takes 
place already on a finite spatial lattice. The systems exhibit a remarkable universality in 
the structure of their generalized ground states. Namely, there are always infinitely many 
non-normalizable and non-invariant ground states which transform irreducibly under a 
preferred representation of the group - the same for a large class of transfer operators! All 
generalized ground states can be generated by forming linear combinations of factorized 
wave functions, where one factor describes the global and the other one the relative 
motion; of course the second factor will be sensitive to the interaction as far as the 
relative motion is concerned; what is universal is the transformation law under global 
symmetry transformations of the first factor. 

In quantum one-particle systems described by an exactly soluble Schrodinger equation 
an infinite degeneracy in the ground state energy has been found earlier: first of all 
in the well known problem of the Landau levels in the Euclidean plane; closer to our 
situation explicitly in [H] for the supersymmetric S0(l,2) invariant quantum mechanics 
and implicitly in [31] (p. 172), [HI] and in [7j for the lowest Landau level. The interplay 
between spontaneous symmetry breaking, nonamenability and properties of the transfer 
operator was understood in |2Sj, initially for the hyperbolic spin chain. 

The thermodynamic limit can usually only be taken on the level of correlation functions, 
so that the 'fate' of the ground state orbit cannot directly be traced. By means of 
an Osterwalder-Schrader reconstruction one can in principle recover a Hilbert space 
description, however inevitably one with an exotic structure; cf. pB]. 

Our main example for Q will be the hyperboloids Hjv := SOo(l, A^)/SO(A^), N > 2, 
in part because of the importance of the Lorentz and de Sitter groups in physics, and 
in part because already for the groups SOo(l,A^) the harmonic analysis exhibits all of 
the characteristic complications. Most of the constructions however generalize to a large 
class of noncompact coset spaces and are actually easier to understand in a general 
setting. We thus specialize to Q = M.n only when needed. 

Let us now make things a little more explicit: the configuration space M. is the direct 
product of V := |A| copies of the space Q. A hypercubical lattice A C Z'^ of arbitrary 
dimension is a prime example, however neither the dimension nor the connectivity 
of the lattice is essential. The pure states of the system are described by elements 
of L^(A^), i.e. functions ip : M. ^ square integrable with respect to the invariant 
measure d'-y. The left diagonal G action d on M. induces a unitary representation 
of G on L'^{M) via (£^(^)^)(m) = ^{g-^m). Since L'^{M) - [L'^{Q)]®^ it can be 
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identified with the z/-fold inner tensor product of the left quasiregular representation 
ii- On this space we consider bounded selfadjoint operators A commuting with the 
group action, i.e. £m o A = Aoij^. Such operators A can only have essential spectrum. 

Specifically we consider so-called transfer operators defining the dynamics of the system. 
A precise definition is given in Definition 12.11 below. Here it may suffice to say that a 
transfer operator is a bounded selfadjoint operator on which is positive as well as 
positivity improving; as usual the latter property is realized by taking for T an integral 
operator with strictly positive kernel, T(m, m') > for all m,m' E Ai. We are interested 
in an invariant dynamics, so we assume ij^ o T = T o £j^. Important examples are T = 
exp(— iJ), with H as in p.l|) . but Hamiltonians with more complicated 'time derivative' 
terms and non-pair potentials would also be allowed. The latter is welcome because 
such complicated Hamiltonians naturally arise as the result of blocking transformations. 
It is easy to see that an invariant transfer operator T cannot be a compact operator, 
furthermore it cannot even have normalizable ground states, i.e. solutions of Tip = \\T\\ip, 
with ip E LF' . (In fact ||T|| must either lie in the continuous spectrum of T or be a limit of 
eigenvalues with infinite multiplicity). Instead our setting is such that T has a continuous 
extension to an operator from to for 1 < p < cx> and we identify conditions under 
which T has generalized ground states. These we take as almost everywhere defined 
functions (not just distributions) which are eigenfunctions with spectral value ||T||. The 
set of these generalized ground states forms a linear space which we call the ground state 
sector Q{T) of T. It is important that T is defined as a selfadjoint operator on a Hilbert 
space, here L'^{Ai), so that the spectral theorem can be applied to provide a resolution 
of the identity. The notion of a generalized ground state is then unambiguous, although 
there is some freedom in the choice of the topological vector space in which the ground 
state wave functions live. 

The separation of global and relative configurations is achieved by writing Ai = Q x A/", 
where A^ collects the 'relative degrees of freedom'; the construction is done in such 
a way that A4 = {G x Af)/d{K), where d{K) is the right diagonal action of K on 
G X M . The details of this construction will be given in Section 2. The global part 
of the configurations can now be Fourier transformed: the functions on G have 
a Plancherel-type decomposition j'^dv{a) La ® where the fiber spaces carry 
the unitary (infinite dimensional) i^-almost always irreducible representations tTq-, and 
V is carried by the so-called restricted dual G^ of G. We show in Section 3 that one 
can associate to an invariant selfadjoint operator A on L^(Ai) a //-measurable field of 
bounded selfadjoint operators A^- on L'^{Af) ® a G Gr, via 



A = j dv{a){l®k^), L^{M) = jdu{a)Cl{M). (1.2) 

In the second formula we indicated that the state space L^(Al) decomposes into fibers 
which carry the representation tTq- and which are preserved under the action of I A^. 
Each of the fiber spaces is isometric to £^(A1) = C^® C^® L'^{N')] however its elements 
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will be realized as functions onAi. This is done by constructing for f G £o- an (antilinear) 
map r„a- : L^{J^) ® ^ / ^ T^^if)- Roughly, the image function arises by 

reinterpreting the matrix element (fin), 7faig)v)a as a (generically not square integrable) 
function on Ai. The map is designed such that it is an isometry onto its image and has 
the following intertwining properties 

Tva{f){9'^rn) = T^,(g)v,a{f){m) , (1.3a) 

[Ar,M)]M = TUKf){m) . (1.3b) 

According to the first equation the G-action on the argument of the function just rotates 
the reference vector v E with the representation tTo-. In the second relation we 
anticipated that the action of A can be extended to the (in general non-L^) functions 
Tvaif)- In view of ()1.3j) it is plausible that the spectral problems of A and A^- are 
related as follows: suppose first that the eigenvalue equations A„x = -^X a-nd AQ = XQ 
are well-defined, with A G Spec(A) and (generically non-L^) eigenf unctions ^) and 
that second the map t^^- admits an extension to the generalized eigenfunctions x of ^a- 
Then by ()1.3b ) the image function r^o-(x) should be an eigenfunction of A enjoying the 
equivariance property ()1.3k ). 

This construction principle can be implemented for a large class of invariant selfadjoint 
operators A specified in Sections 3.3 and 3.4. In overview the result is that a set of 
generalized eigenfunctions Qao- exists for almost all A G Spec(A) and cr G Gr with the 
following properties: (i) they are almost everywhere defined functions (not distributions) 
^A,o- M. ^ C (ii) they are cr-equivariant, i.e. they lie in the image of the maps r^^a, 
where {cj} is an orthonormal basis of and where the domain is the linear hull of a 
complete set of eigenfunctions of A^- with spectral value A G SpecAo-. (iii) fl\a{,gm) — > 0, 
as g leaves compact subsets of G. (iv) As A runs through Spec(A) and a runs through 
Gr, the eigenfunctions ^ao- are complete, in the sense that any smooth function can be 
expanded in terms of the Qx„ and that a Parseval relation holds on {L^ fl L'^){Ai). 

The transfer operators T considered are special cases of such invariant selfadjoint opera- 
tors, which in addition are positive and positivity improving. The spectral value relevant 
for the ground states of a transfer operator T is A = ||T||. The important "almost all 
A G Spec(T)" clause in the above completeness result prevents one from getting all the 
generalized ground states simply by specialization. However, whenever for some a G Gr 
a complete set of eigenfunctions of T^- with spectral value ||T|| can be found, their images 
under Te-o- will produce ^^-(T), the space of cr-equivariant generalized ground states. 

Off hand of course every a G Gr could occur as a "representation carried by the ground 
state sector" in ^^-(T). Remarkably this is not the case: under fairly broad conditions 
only one representation occurs and always the same! For definiteness we formulate the 
following results for G = SOo(l, N), K = SO(iV), M = SO(A^— 1); many aspects however 
are valid for any noncompact linear reductive Lie group. 

Theorem 1.1. Let T be a transfer operator on L"^ {M. , d'j) commuting with the unitary 
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representation induced by a proper action d of G. In terms of the fiber decomposition 
M.^) one has: 

(a) ^(r(T) is empty for all but the principal series representations whenever one of the 
following holds: (i) Q^jiT^) contains a strictly positive function, (ii) QcriT) contains 
a K -singlet. (Hi) T„ is compact. 

(b) ^(r(T) is non-empty for at most one of the principal series representations - the 
limit of the spherical (M-singlet) principal series. 

Combined (a) and (b) imply that if there are generahzed ground states which transform 
equivariantly according to some unitary irreducible representation tTo-, this representation 
must be - under any of the conditions (i)-(iii) and possibly others - the limit of the 
spherical principal series, for which we write vtoo- 

It remains to establish the existence of such generalized ground states. The known 
construction principles for generalized eigenfunctions (the classic ones [El 01] , as well as 
the one described above) are not sufficient to assure the existence of generalized ground 
states (neither as functions nor as distributions) - so any of the fiber spaces in Theorem 
1.1 could be empty, including ^oo(T). In a follow-up paper we describe a construction 
principle which ensures the existence of generalized ground states in various situations; a 
preview is given in the conclusions. There is a simple case that is, however, important for 
applications, in which the existence of generalized ground states is immediate: the case 
that all the fiber operators are compact. The eigenspaces with eigenvalue ||To-|| can 
in principle be constructed via the well-known projector s-limt^oo(T(j/||To-||)* (where the 
limit exists in the strong operator sense). One then has the following concrete variant 
of Theorem 1.1: 

Theorem 1.2. Let T be as in Theorem 1.1 and assume in addition that the fiber opera- 
tors T^, a & Gr are compact. Then all fiber spaces except Qoo(T) are empty. Further Tqq 
is itself a transfer operator which has a unique ground state in ^oo(T) C L'^{N) (8>>Co-=oo- 
In the realization of Co-=oo L'^{S^~^) this ground state can be represented by a unique 
a.e. positive function ipo. QiT) is the linear span of functions of the form 

n{q,n)= [ dS{p) (1.4) 

where q = gq^ = {qo, q). Here M. was identified with Q x Af in a way that replaces the 
original diagonal left G action by q ^ gq. 

For comparison we mention here the corresponding results for amenable (compact or 
abelian) Lie groups. When T is invariant under the action of a compact Lie group, 
the very same setting entails that the ground states have three concordant proper- 
ties: normalizability, uniqueness, and invariance. That is, there exists a normalizable. 
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nondegenerate ground state, which is a group singlet. This ground state can be ob- 
tained by acting with a projector P on an arbitrary LF' function, where P is obtained 
as the strong operator hmit of the iterated (compact or trace class) transfer operator: 
P = s — limt^oo(T/||T||)*. When T does not have normalizable ground states this limit 
does not exist; the corresponding weak limit will be the null vector. A construction of 
generalized ground states based on a similar but more subtle fixed point principle will 
be discussed in [39|; see the conclusions for a preview. 

When T is invariant under a noncompact amenable Lie group, for instance in the Eu- 
clidean case Q = ISO(A^)/SO(A^), our construction resembles the well-known procedure 
of separating the center-of-mass motion (see for instance It yields a ground state 

sector carrying the trivial representation of ISO(A^) and for which the center-of-mass 
wave function is unique (the properties of the 'internal' ground state sector replacing 
^(Too) again depend on the details of the interaction). Of the three concordant proper- 
ties above only the normalizability is lost. In appendix C we specialize our constructions 
to this degenerate situation, to contrast it with the non-amenable case. 

Both amenable cases have in common that the representation carried by the ground 
state sector is uniquely determined and always the same, namely the trivial one. The 
above results show which aspects of this picture generalize to the case of non-amenable 
symmetries (namely, the uniqueness of the representation and its universality) and which 
do not (viz, the uniqueness of the ground state). In view of Theorems 1.1 and 1.2 the 
limit of the spherical principal series appears to be the natural generalization of the 
singlet in the noncompact setting. 

The article is organized as follows. In Section 2 we describe the setting in more detail 
and explain why the Gel'fand-Maurin theory is insufficient to account for the results 
we are aiming at. The fiber decomposition of L'^{A4) is introduced. Section 3 provides 
the adapted fiber decomposition of a wider class of selfadjoint operators A and relates 
the spectral problem of A to that of the fiber operators A^-. These results are then 
applied in Section 4 to the ground state sector of transfer operators, giving a proof 
of Theorem 1.1 and ramifications of it. Appendices A and B provide the necessary 
background on the harmonic analysis of non-compact Lie groups. In appendix C we 
collect counterparts of some of the results in the trivial case of a fiat symmetric space, 
for the sake of contradistinction. For further orientation we refer to the table of contents. 
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2. Group decomposition of the state space 

Here we introduce the class of systems considered and prepare an orbit decomposition 
of the configuration manifold. The wave functions (square integrable functions on this 
manifold) are then subjected to a Plancherel decomposition with respect to their global 
position, which is parameterized by an element of G. Eventually this gives rise to 
a decomposition of the state space L'^{^A) into fibers labeled by irreducible unitary 
representations of the original group action. 



2.1 Generalized spin systems 

We consider generalized spin systems of the following type: the dynamical variables 
take values in an indecomposable Riemannian symmetric space Q := G/K, with G a 
noncompact Lie group and K a maximal compact subgroup. The Lie groups will be taken 
to be linear reductive, meaning that G is a closed subgroup of GL(A^, M) or GL(A^, C) 
which is stable under conjugate transpose. K then is the isotropy group of the point = 
eK G Q. We further assume that there is an involution l such that K consists of its fixed 
points, and that gL{g)~^ has unit determinant. Then G and K form a symmetric pair. 
Examples are SOo(l, A^)/SO(A^), SL(A^, M)/SO(A^), U(p,g)/U(p) x U(g). In Appendix 
C we will also consider the degenerate case = ISO(A^)/SO(A^). The configuration 
manifold Ai is the direct product of u := |A| > 2 copies of this space. For much of 
the following A only has to have the structure of a point set; it is assumed though that 
I' ^ oo captures the physical intuition of a thermodynamic limit. A hypercubical lattice 
A C Z'^ of arbitrary dimension is a prime example, however neither the dimension nor 
the structure of the lattice is essential. Ordering the points in some way, we write 
m = {qi, . . . ,q,y) for the points in Ai. Further we denote by 7q and d'jQ the invariant 
metric and the measure on Q. Equipped with the product metric 7(m) := Yli/lQi^li) 
and the product measure d-^im) := Hi'^TqI'?*) configuration space is a simply 
connected Riemannian manifold, and in fact a reducible Riemannian symmetric space. 
Further M. carries an action d : GxAi ^ A4 of the group G, via d{g){m) = {gqi, . . . gqu), 
where q —>■ gq is the left (transitive) action of G on Q. Clearly d{g) is an isometry and 
d{g){m) = m for all m implies that g is the identity in G, that is, the action of G is 
effective. Since d{G) := {d{g), g G G} is a subgroup of the full isometry group which is 
closed in the compact-open topology, {Ai, 7) also is a proper Riemannian G-manifold in 
the sense of Section 5. In fact, the main reason for considering product manifolds 
of the above type is that they have a well defined orbit decompositon At = Q x Af, 
M /d{K) = Ai /d{G), to be described later. With certain refinements this generalizes to 
all proper Riemannian G-manifolds, see 

The pure states of the system are described by elements of L'^{Ai), i.e. functions ip : 
A4 ^ C, square integrable with respect to d'j. The proper G action li on induces 
a unitary representation ij^ of G on L^(A^) via (-^a^ ((?)'?/') (^) = 4>{d{g~^){m)). Since 
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L'^{Ai) ~ [L'^{Q)]'^'' it can be identified with the z/-fold inner tensor product of the left 
quasi-regular representation £i of G on L'^{Q); we write ~ if'^. 

As outhned before, we call a bounded selfadjoint T on L'^{Ai) a transfer operator if it 
is positive as well as positivity improving. Positivity of T means {ip,Tip) > 0, which 
is equivalent to the spectrum being nonnegative. Typical transfer operators are also 
positivity improving because they arise as integral operators with a positive kernel; the 
formalization as a positivity improving map turned out to be useful, see jH] p. 201 ff. 
For convenience we recall the definitions: a function Ai 3 m ^ tp{m) G C has some 
property almost everywhere (a.e.) if it holds for all m G A^\/ with 7(1) = 0. A nonzero 
function is called positive if > a.e. and strictly positive if ip > a.e. Then T is 
called positivity preserving if (T-?/;)(m) > a.e. and positivity improving if (T-?/')(m) > 
a.e. for any positive ip. Equivalently T is positivity improving iff {(pjTip) > for all 
positive (f),ip e L^; see p. 202. 

Our notion of transfer operators requires an additional condition: 

Definition 2.1. A transfer operator T is a positive integral operator, given by 

(T^)(m) = d-f{m')T{m,m')ip{m') . (2.1) 



where the kernel T : Ai x M ^ M+ is symmetric, continuous and strictly positive, 
i.e. T{m,m') > a.e. and satisfies 



sup / d'y{m')T{m,m') < 00. (2.2) 

m J 



The second condition is sufficient (but by no means necessary) to ensure that T defines 
a bounded operator from to for 1 < p < oo; see ISH] p.l73 ff. The operator norm 
||T||lp^lp = sup||^||p=]^||T0||p is bounded by the integral in ()2.2|1 and coincides with it 
for p = I, 00. Positivity of the kernel entails that T is positivity improving. Positivity 
of the operator (that is, of its spectrum) does not follow from this. However if it is 
not satisfied we can switch to and the associated integral kernel, where positivity is 
manifest. Without much loss of generality we assume therefore the kernel to be such 
that T is positive. As a bounded symmetric operator on the integral operator defined 
by T(m, m') has a unique selfadjoint extension which we denote by the same symbol T. 
The kernel of T* will be denoted by T(m, m'; t) for t G N. In this situation T and all its 
powers are transfer operators in the sense of the previous definition. 

An invariant dynamics is specified by a G-invariant transfer operator, i.e. one which 
commutes with Em on 



{g)oT = ToeM{9), ygeG. (2.3) 



It is easy to see that T then cannot have normalizable ground states (see Proposition 
13.11 below). In this situation one will naturally search for generalized eigenstates of T, 
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which in our case will be simply solutions of Tfi = ||T||fi with f2 an almost everywhere 
defined function (not just a distribution) on A4. The set of generalized ground states 
forms a linear space which we call the ground state sector Q{T) of T. 



2.2 The spectral problem 

Since T commutes with the G action one expects that the transfer operator and a set 
of operators Z whose diagonal action characterizes an irreducible representation can be 
diagonalized simultaneously. In a sense this is correct and the generalized eigenfunctions 
with spectral value ||T|| in fact belong to a special irreducible representation of G, 
see Theorem 1.1. The purpose of this interlude is to explain why the general results 
available in the literature on such (simultaneous) spectral decompositions are insufficient 
to produce the generalized ground states sought for. 

Let A be a bounded selfadjoint operator on the separable Hilbert space L^(A^). Let 
$ C L^(A4) C $' be a Gel'fand triple [El E] (rigged Hilbert space) for A. An element 
e is called an eigendistribution or generalized eigenstate of A with spectral value 
A G Spec(A) if (0, (A — X)Q) = 0, for all G $. The set of generalized eigenstates 
for some A G Spec(A) forms a linear subspace of which is called the generalized 
eigenspace Sx{A) for the spectral value A G Spec(A). If L'^{Ai) carries the unitary 
representation £m of a connected (noncompact) Lie group group G there is a natural 
action of G on the distributions Q G viz {Im{.9) ° 0) •= (S^i^m^q)'^ ° 0) for all 
G $ and g & G. Naturally Q is called invariant if ^Mid) o f2 = for all G G. If A 
commutes with ij\^{g)oA = Aoij^(^g) for all g E G, one expects that the generalized 
eigenspaces can be decomposed into components irreducible with respect to Em- Under 
mild extra conditions this is indeed the case. The nuclear spectral theorem (Gel'fand- 
Maurin theorem, [121 El]) guarantees the existence of direct integral decompositions of 
the form 



Here G is the dual of G and ^{X, a) is a measure on Spec(A) x G defining the decompo- 
sition. To simplify the notation we identified elements tt„ of G with a set of parameters 
a uniquely specifying an equivalence class of unitary irreducible representations. The 
precise version of the nuclear spectral theorem can be found in ^3 IHH IHl- The fiber 
spaces £^a,(t(A) contain the generalized eigenfunctions of A in $' transforming irreducibly 
under G. The nuclear spaces $ are much smaller than L^, the dual spaces therefore 
much larger than L°^, and the generalized eigenfunctions supplied by the Gel'fand type 
constructions may be genuine distributions. The fact that A commutes with the elliptic 
Nelson operator of G (built from the Casimirs of G and K) entails [S3 that the (av- 
eraged) eigendistributions iMio) ° ^ are smooth functions in g, but little can be said 
about their distributional type. A result by Berezanskii (described and proven in ^34 ) 
specifies sufficient conditions under which the dual space $' of a triple $ C C $' 




(2.4) 
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consists of almost everywhere defined functions (not distributions). We shall make use 
of this result for the 'relative motion' alluded to in the introduction. Irrespective of the 
distributional type of the generalized eigenfunctions the decomposition ()2.4|) has however 
two important drawbacks: 

- generalized eigenfunctions are assured to exist only for /i-almost all spectral values 

A G Spec(A), and the measure /i is usually not known explicitly. 

- whenever generalized eigenfunctions exist for a given A G Spec(A), let Gx C G 

denote a set that carries the restricted measure in ()2.4|) . Then the spaces £^a,o-(A) 
are assured to be irreducible only for /i-almost all a G Ga. 

The first of these 'almost all' caveats presents a major obstruction if one wants to apply 
the general framework to a specific spectral value, like ||T||, the ground state value, 
which is our main concern here. 

The following example illustrates the problem. Let T be the integral operator on L^(M_|_) 
defined by the kernel T{x,y) = e"l^'^^L It can be seen to be a transfer operator in the 
above sense with spectrum Spec(T) = [0, 2]. For all spectral values different from A = 2 
there exist generalized eigenstates, yet the operator does not have a generalized 
ground state. The point to observe is that for all G L^(]R+) the image function 
(Tip){x) is twice differentiable with 

(TV')" = (T^) - 2^ . (2.5) 

All solutions of Tip = Xip therefore must be linear combinations of e^*"^^ with u = 
y27A(IIO^, i-e- A(o^) = 2/(1 + u^). One finds 

i^ujjx) = -.[smujx + uj cosuix] = cos{uJX — b) , uj > , 6 = arccot ci; , (2.6) 



UJ 



where the normalization has been chosen such that HV't^Hoo = 1- The explicit construction 
shows that ipi^ G although the space of test functions is slightly smaller than in 
that twice differentiable functions have to satisfy 0(0) = 5a;0(O) (which can be seen 
by averaging Eq. ()2.5j) with a test function). The fact that the generalized eigenfunctions 
()2.6|) also satisfy ■0(^(0) = dr^ip^^O) ensures their completeness; it is easy to verify that 

71 

duip^{x)'ip^{y) = - 6{x -y) , x,y>0, 



oo 



dx ip^^ ix)ip^2 (x) = 0, 7^ ^2 • (2.7) 
Using Eq. ()2.7p we find the following spectral resolution of the integral kernel T: 



oo 



TT Jn V 1 + 



T{x,y;n) = - I du [ ~ ) V^(a;)V'<^(?/) . (2.8) 
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For example 



r{x,y-2) = e-\^~y\{l + \x-y\)--e~^^^yK 



(2.9) 



Despite these nice properties no generalized ground state exists. This is because can- 
didates for it must be contained in the set ()2.(ij) : however the relevant limit (A — 2 
i.e. — >• 0) vanishes pointwise, while the closest maximum of ifj^, lying at b{uj)/uj ~ 
n/{2u!), moves out to oo. 

The upshot is that the 'almost all' caveat in the general theorems is crucial for their 
validity and renders them at the same time useless for the construction e.g. of the 
ground state sector. Even transfer operators with a complete system of regular (here: 
L°°) generalized eigenf unctions may fail to have a ground state. This explains why in the 
constructive Theorem 5.1 certain subsidiary conditions must be present; we do expect 
however that the ones given can still be weakened. 

In Section 3 we will analyze the spectral problem for invariant selfadjoint operators A as 
defined in Definition 3.1. Under mild subsidiary conditions ((C) in Section 3.3 and (CI), 
(C2) in Section 3.4) a complete set of eigenfunctions flxa in can be found. Some 

of the properties of the have been anticipated in the introduction. In this context 
it is worth emphazising two points. First, in contrast to the familar situation with 
normalizable eigenfunctions the existence of a f2 G such that AQ = XQ does in itself 
not imply A G Spec(A). A simple counterexample is the hyperbolic spin chain discussed 
in detail in : there the constant functions are eigenfunctions of the transfer operator 
T, but the corresponding eigenvalue lies above the spectrum of T. When solving the 
spectral problem AQ = XQ with a nonnormalizable Q G the information that A is 
a point in the spectrum therefore has to be supplied independently. A second point 
worth repeating is that all known construction principles for generalized eigenfunctions 
(including the one presented in Section 3) are guaranteed to work only for almost all 
points in the spectrum. For a prescribed A G Spec (A) additional considerations are 
necessary to show that sufficiently many eigenfunctions exist. This applies in particular 
to the (T-equivariant eigenspaces Sxcr{A) of an invariant selfadjoint operator A and to 
the ground state fibers := £^||t||,o-(T) of a transfer operator. 

Whenever the fiber spaces £^a,(t(A) in ()2.4j) are nonempty for a fixed X G Spec(A) one 
can match the decomposition in ()2.4|1 with the purely group theoretical one. Since £m 
is a unitary representation on general grounds it can be decomposed into irreducible 
components 0. That is, there exists a measure //^^ on G such that 



where the fibers £^(A^) are irreducible for //^^-almost all a G G in the support of the 
measure. On the other hand from ()2.4j] one can define generalized eigenspaces Sx{A) by 
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(2.11) 



where G\ denotes the part of G for which there is a non-empty eigenspace £\^fj{A). 

Thus /spec(A) '^'^('^' ~ ^f^iAdi^)- There are no obvious strategies to determine the 
representation content Gx C G of a given spectral value A (for which generalized eigen- 
functions exist). For a transfer operator T we identify its ground state sector ^(T) with 
£^I|T||(T), and similarly for the equivariant fibers ^^(T) = S\\T\\^a{T)- We shall thus apply 
the decomposition ()2.1H1 also for the ground state sector and write G\\t\\ for its repre- 
sentation content. One of the main goals later on will be to show that under moderate 
extra assumptions Guru consists of a single point (a single representation) only, which 
is always the same for all transfer operators considered. 



2.3 Orbit decomposition 

A simple but crucial fact about the configuration manifolds = Q x . . . x Q is that 
they have a well defined orbit decomposition which eventually carries over to the states 
and the operators acting on them. The idea of the decomposition is to single out one of 
the variables in m = {qi, . . . ,q^), say gi, to parameterize the location on the orbits and 
to define coordinate functions transversal to it to describe the relative location of the 
points such that they change only by elements of K as one moves along an orbit. To this 
end we fix some E Q = cK with isotropy group K, i.e. kq^ = q^ for all k E K. Based 
on it we wish to define a section Qs : Q ^ G such that q = gs{q)q^ for all g G Q. Clearly 
this condition defines gs only up to right multiplication by some ks = ks{g, q) G 

9s{gq) = ggs{q)ks{g, q) ■ (2.12) 

For gs to be well-defined the element k has to be uniquely determined for given g and 
q. It is easy to see that this is the case whenever G admits an Iwasawa decomposition, 
which is the case for all connected simple noncompact Lie groups, in particular the ones 
considered. Consistency requires the cocycle condition ks{gig2,q) = ks{g2, (l)ks{gi, g2(l), 
in particular ks{e, q) = e for all g G Q and e E G the identity. If we normahze gs such that 
gs{q^) = e it follows that ks{gs{q),q^) = e = ks{gs{q)~'^,q) and ks{g,q) = ks{ggs{q), q^). 
For elements k E K oi the subgroup one has ks{k,q^) = k~^. Generally the Iwasawa 
decomposition entails that the cocycle ks{- ,q) : G ^ K is surjective for all q E Q. 

Our main example for the symmetric space Q will be Mjy = SOo(l, A)/SO(A^), the 
A^-dimensional hyperboloid with the Riemannian metric 7ejv induced by the indefinite 
metric q ■ q = {q^Y — (g^)^ — ... — (g^)^ in the imbedding linear space. Explicitly 
Mat = {g G M^'^ | g ■ g = (g°)^ - (g^)^ - ... - (g^)^ = 1, g° > 0}. The invariant measure 
on Hat is d'yu^i^q) = d^^^q5{q^ — l)6'(g°) and will be denoted by dq for short. The 
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i/-fold product M. = equipped with the product metric then is a simply connected 
Riemannian manifold (and, in fact, a reducible symmetric space). We denote the product 
measure 11^=1 dlM- For G = SOo(l,A^) and K = SO(A^) the section 
gs{q) is just the familar expression for the pure boost mapping = (1,0, ...,0) to 
q = (go, gi, • • • , g^v-i) =: (go, q)- Exphcitly 



qo 



9s{q) 



->T 

q 



I + qq 

<?o+l ^ ^ 



(2.13) 



It satisfies gs{q) = e iff g = g^. The cocycle ks{g,q) = gs{q) ^g ^gs{gq) based on this 
section is known as 'Wigner rotation' 59^ and satisfies 

ks{k, q) = k^^ for all q e Q, k e K , (2.14) 

that is, not only for q = q^ . 

Using the section gg we now define the following diffeomorphism on M. = Q'^: 

??(gi, . . . , g^) = (gi, 5's(gi)"^g2, • • • , fi's(gi)"^gz.) =: (gi, ri2, . . . , n„) , 

^'^{qi, ?^2, • • • , n^) = (gi, gsiqi)n2, • • • , gsiqiW) . (2.15) 

This diffeomorhism is measure preserving due to the invariance of the measures dqt:. let 
/ e L^ld'jM) and dn := d-i^f{n) := Hj^i d^qirii). Then 



(/ o ?9)(gi,ra)d7^(m) 



/ / W^^^li f((l^^9s{qi) ^q2,- ■■,gs{qi) ^qu) 



= Jdqi jYldqif{qi,...,qu)=jd'yM{m)f{m). (2.16) 

So the measure d'jM can also be factorized as 

(i7_A4(m) = dqidn, (2-17) 

The product Q x Af equipped with the product metric 7q x 7^ and the measure dq dn 
is a Riemannian manifold Aig which by construction is isometric to Ai, and with the 
isometry given by the above 'd: 

^■.{M,'y) {Ms,is):={Qy<Ar,lQy<lM). (2.18) 

The manifold Ais also has the structure of a G space which it inherits from Ai. 
Recall that the transversal coordinate functions rii = ni{qi,qi) G Q are defined by 
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Hi := QsiqiY^qi, for i = 2, . . . , I/. On them acts by iM{9){ni) = 9 s{g'^ QiY^ 9'^ Qi = 
ks{9~^,qi)~^ni. The original diagonal action d{g)m = {gqi, . . . ,9qu) becomes a twisted 
action ds (depending on a choice of section) in the coordinates (g, n), i.e. 'd o d = dgO'd, 
with 

ds{9~^){q, n) = ig~\, hig'', qVn) . (2.19) 

As ds{gsiq)){qo,n) = {q,n) and ds{gs{q)~^){q,n) = {qo,n) it acts transitively on the first 
variable. However as one moves along Q the action ds co-rotates the n variables in a 
g-dependent way. For a generic symmetric space this happens even on the subgroup K; 
for Hjv and the Wigner rotation one has ds{k~^){q,n) = {k~^q, k~^n), though. In the 
terminology of jHOj, Section 4, := Q x^^ A/" is the skew product G-space induced 
from the i^'-space Af. Indeed, Af equipped with the diagonal action of K: dj^{k)n = 
{k~^n2, . . . , k~^n^) is a i^'-space, and by construction {AA, d) and (A^s, ds) are isometric 
as G spaces. Since the cocycle is surjective for fixed q we gained a less redundant 
description of the space of orbits: 

space of orbits: M/d{G) = Ms/ds{G) = M/dj^{K) , (2.20) 

where, importantly, K is compact. On the other hand, the twisted action ()2.19|1 is 
cumbersome when one tries to decompose the unitary representation based on ds into 
irreducible components. But the left twisted action ds can be traded for an untwisted 
right action r by the following construction (based on a remark in [Sni, p. 75). Consider 

Mr := {G X U)/d{K), (2.21) 

that is, the space of equivalence classes ((?, n) ~ {k~^g, k~^n), k E K in G x A/". In order 
not to clutter the notation we also write {g, n) for the equivalence class generated by a 
point in G X M. Maps and functions on G x A/" that are constant on d{K) orbits then 
lift unambiguously to maps and functions on M.^- On G x A/ and A/l^ we define a right 
G-action r by 

r{g'){g,n) = {gg',n), (2.22) 

which is just the standard right action of G on itself leaving the n variables untouched. 
The action ()2.22j) is constant on the equivalence classes because the right r{G) action 
and the left d{K) action on G x A/" commute, r{g)d{k) = d{k)r{g). In fact Air equipped 
with the right G action is isomorphic to the original manifold Ai = Q'^ with the diagonal 
left action Im{G) (and thereby also to the skew product G space M.s = Q x^^ Af). The 
isomorphism is given by first considering the following map (p : A4 ^ G x Af: 

fj): M — > GxAf, 

0(gi, . . . , g^) = {gs{qi)'\gs{qi)'^q2 • • • , 9s{qi)'^q,y) ■ (2.23) 

This map is injective, but not surjective. Because gs is a global section of G/K its range 
intersects each d{K) orbit exactly once, so that it determines uniquely a diffeomorphism 
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(j):M — > Mr. (2.24) 

We define an inverse of (f)~^ : G x JV — > M. (initially only defined on the range of 0) 
by 

~^~\g,n) = d{g-^){q\n). (2.25) 

We can immediately interpret this as a map from all oi G x M to M. which is constant 
on the equivalence classes under d{K) 

4>-\kg,kn) = d{kg){q\kn) = ig-\\g-'n) = r\9.n) , (2.26) 

and hence lifts to a map : M.r — > M.. By direct computation one verifies 

0o0-i = id, (2.27) 

whereas cj)^^ o only maps orbits of d{K) into themselves. But this is enough to see 
that (j) and 0"^ are really inverse to each other. 

According to ()2.22|1 the map intertwines the left action d{G) with the right action 
r(G): 

(f)od = ro(f). (2.28) 

In addition the map is measure preserving; this can be seen similarly as the measure 
preserving property of ^: consider a function / on and let = / o 0^^. Then, 
using the G-invariance of the measure dn and the fact that the invariant measure dq is 
the push-forward of Haar measure dg under the canonical projection G — > G/K, one 
sees that 

YldlQi(li)f{(li,---,(lu) = dg dnfr{g,n) . (2.29) 
^ i=i 

For completeness we also note explicitly the isometry x = <f) o between the skew 
product Q space J^s = Q X/t^-^ the G-manifold Air with the diagonal right action: 

X ■ Q Xks^f ^ Mr , Xiq,n) = igsiqy\n) , 
X'' : Mr^Qxk^Af, x'\9,n) = {g-\\ks{g-\q^)-'n) . (2.30) 

In summary we have two equivalent descriptions of the original G- manifold {M,d), 
namely {Ms,ds) and {Mr,r). The second one is more convenient for the reduction 
problem because the space of orbits M/d{G) = Mr/r{G) is now described by equiva- 
lence classes with respect to the usual right action of G on itself. 
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This structure of course carries over to the function spaces and the unitary representa- 
tions on them induced by the G-actions. We have 

L\M) 9 ^ ^ i^MigWim) = ij{dig-'){m)) , (2.31a) 
L'{Ms)3tlJs ^ {L{9)^PsMn)=tlJs{ds{9~'Mn), (2.31b) 
L'^{Mr) 3ipr {p{go)ipr){g,n) = i;r{r{go){g,n)), 4(ir)V'r = V'r, (2.31c) 

where ir{k)tlJr{g, n) = iprik^^g, k^^n). As Hilbert spaces of course all three spaces are 
isometric to L'^{Q x M) and the three representations (-mAs^ and p are likewise unitarily 
equivalent. Explicitly 

p = $-1 o o $ (2.32) 

and similarly for L^(A^s). By ()2.31b ) L'^{Air) can also be identified with the subspace 
invariant under £r{K) of L'^{G x A/"). By ()2.29j) the map $ is indeed an isometry. As 
($~-^ o iMido) ° ^i^r){g,n) = il)r{4> ° d(gQ^) o (j)~^[g^n)) the unitary equivalence of the 
representations follows from ()2.28|1 . 

We summarize our results in 

Proposition 2.1. There is a diffeomorphism from the configuration manifold M. = 
to Mr = {G X Q^^^) / d{K) such that the diagonal left action d{G) on M. gets mapped 
into the right action r{G) on the first factor of Air- 4> is measure preserving for the 
natural measures on M. and Air CLnd therefore induces a natural isomorphism of the 
spaces L'^{Ai) and L'^{Air)- 



2.4 The reduction of p(G) on L^{Mr) 

With these preparations at hand we can now address the reduction problem of d-M-iG) 
in the variant where it acts as p{G) on L'^{Air). As noted above, the latter is the ir{K) 
invariant subspace of L^(G x A/"), which carries the commuting unitary representations 
p{G) and ir{K). Moreover p{G) for fixed n G TV is just the right regular representation of 
G mapping ipr{g,n) into p{go)4'r{g , n) = ipriggoyn). Its decomposition into unitary irre- 
ducible representations tt„, a G Gr, is thus given by the Plancherel decomposition ()A.1|) . 
The precise form used and the notations are summarized in appendix A. In particular 
dv is the Plancherel measure on G^, the restricted dual of G, and g ^ T^u{.g) denotes the 
irreducible representation associated with some a & Gr- It acts on a separable Hilbert 
space Ca with inner product {■,-)a- 
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Applying the expansion ()A.2j) to the G-part of a function in ^/^ : G x A/" — > C gives 



i^{9,n) = I du{a)TT[K„{g)ij{a,n)], 

^{a,n) = / dg-K„{g-^)ip{g,n) . (2.33) 
Jg 

For functions that are ir{K) invariant this will lead to the desired decomposition of 
L'^{A4r) into irreducible components. We consider here first the decomposition of the 
larger space L^(G x J\f). Provided suitable conditions are imposed on the function ijj 
(which we describe shortly) the transforms ipicr, n) for fixed n are trace class or Hilbert- 
Schmidt operators on Ca- Further they satisfy 

[p{9o)(-{9M] {(^,n) = TT^ (5(0)^(0-, n)7r^(5(f^) = (tt^ x tt^) (5(0, 5-1)^^(0", n) , (2.34) 

using ()A.6|) and the notation tt„ = tt^ in the last equation. This states that the map 
ijj ^ ip intertwines the outer tensor product p x i of the left and the right regular 
representation of G with tt^ x tt^. 

Throughout we shall adopt the following conventions for compact operators A,B on 
some separable Hilbert space TC with orthonormal basis Ci, i eN, and its dual space H 
with dual basis Cj, i G N: 

A = ^ ^ CiAijCj , ~ A*^ . (2.35) 

Compact operators that are even trace class arise for example as Fourier transforms of 
functions ip where V is the space of functions ip{g, n) that are smooth with compact 
support m g E G and square integrable in n G M: for such ip the Fourier transform 
Tp^a.n) is a trace class operator on a separable Hilbert space C^j, for all ip E V, and 
almost all a E Gr, n E M . Moreover the Fourier expansion ()2.33p then is valid pointwise 
in g. If ip is in L'^{G) fl L^{G) as a function of g and square integrable in n the Fourier 
coefficients V'(c) are still Hilbert-Schmidt operators for almost all a G G^, n G Af. We 
identify the trace class operators with a subspace of C„ ^ C^, which in turn can be 
identified with the space of Hilbert-Schmidt operators on C^; see Appendix A3. This 
means the coefficients are functions 'ipi^a, ■ ) : N ^ ® ta- The Parseval identity 

I dg (Pig, ny^ig, n') = j du{a) Tr [0(a, n)t^(a, n')] , (2.36) 

t/ G J Gt 

is valid for all functions in L^(A^r) which for fixed n lie in L^{G) fl LP'{G). It implies 
that the trace Ti[^{a,nyip{(T,ny\ is integrable with respect to dh'{a)dn; hence it is an 
integrable function on Af for almost all a E Gr- 
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This suggests to equip the fibers at fixed a E Gr with the structure of a Hilbert space 
which we denote by Ll^{Af). We shall also need various subspaces of L'^^{M) and for 
convenient reference we collect them in the following definition. 

Definition 2.2. The Hilbert spaces 

Ll^{U) := {f : A/- ^ ® 4 I {F, F)„^ < <x?^ = ® ® L\U) , (2.37a) 

LI^{M)o.= [f -.M ^ C^®C, I {F,F),^ < oo, F{k-^n)Ti,{k)^ = F{n)Y (2.37b) 

where {Fi,F2)aa '■= JdnTT[Fl{n)F2{n)] are called the fiber spaces of L'^{G x A/") and 
L'^{A4r), respectively. Let K be the unitary dual of K, k G K, and \4 C £5- the 
subspaces in Eq. \2.4^ below. Then 

Ll-^{U) ■.= {f -.U ^ C,®Vf, \ if, fU < 00} = £^ ® \4 ® L\Af) , (2.38a) 

Ll,iAf)o :={f:Af^C^^V,\ f{kn) = f{n)r,{k)^ , (/, fU < 00} , (2.38b) 

where (/i, f2)ak '■= J dnTYy^[fi{nyf2{n)] are called the n-channels ofL^^^Af) and Ll^{Af)o, 
respectively. The adjoints of the singlet channels k = lead to spaces 

Lli^^)■.= [f■.^^^C^\ j dnif{n), f{n))„ <^~^=C^®L\U), (2.39a) 

Ll{U)o := {/ e LliAf) \f{kn) = n^{k)f{n)} . (2.39b) 
With the definition ()2.37b ) the Fourier transformation ()2.33|) becomes an isometry 



dgdni/j{g,nyip{g,n)= diy{a) {iIj,^;)^^ , (2.40) 

Jdr 

which extends uniquely to an isometry between Hilbert spaces. Since the trace class 
operators form an ideal in the algebra of all bounded linear operators on for al\ip &V 
the trace TY[7i„{g) 'ip{a, n)] is defined pointwise for all {g, n) G GxJ\f and it is a continuous 
function in g. For the same reason [p{go)i{gi)'ip] {cr,n) = 7ia{go)i^{<J,n)TT(j{giy is a trace 
class operator for all go,gi if '?/'((T, n) is. As a consequence L'^^{J\f) carries a unitary 
representation tTo-o- of G x G 

T^aai9o,9i)F{n) := 7^^(fi'o)^(^)7^a(fi'l)^ 

{^aai9o,9i)Fu7T,^igo,gi)F2)^^ = (^1,^2),-. (2.41) 

It coincides with tTo- x n^, the outer tensor product of the two representations (which 
is irreducible jTH], Thm 7.20]) whenever both of the factors are. The isometry ()2.4()j) 
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therefore also provides the decomposition of p x £, the outer tensor product of the right 
and the left regular representation of G into a direct integral of (i/-almost everwhere) 
irreducible representations, 

p X £ = J dv{a) -K^x -K^. (2.42) 

With these preparations at hand we can turn to the decomposition of LF'{M.r)i which 
we naturally identified with the subspace of x M) consisting of left K invariant 

functions. Clearly the left K invariance of the function ip translates into the following 
condition on the Fourier coefficients 

[lr{k)^] {a, n) = ^{a, k-^n)Tx^{k)^ = i){a, n) . (2.43) 

We also introduce the corresponding i^'-singlet subspace of Ll~{J\f) as in ()2.37b ). Since 
ttI 'acting from the right' is unitarily equivalent to tt^, in representation theoretical terms 
means 

X TT^I^ 1 id (2.44) 

where ij^{k)F{n) := F{k~^n). The condition (!) can be understood as the projection 
onto the subspace of left K singlets in a decomposition of L'^{G) ® L'^{N) which we 
prepare now. 

First recall that the restriction of vTo- to the subgroup K decomposes as follows 

t^Ak = ^mf^Tk, Cij=^mfyf,. (2.45) 

Here the subset C K for which the irreducible representations on the finite dimen- 
sional vector space Vf^ occurs with nonzero multiplicity is called the K content of tt^; 
see appendix A. Often it is convenient to use a basis of obtained by concatenation 
of the bases e^s, s = 0, . . . jm^dimV^ — 1, of m^VJ;. (Here of course for fixed k the 
basis vectors ens, s = 0, . . . jdimV^ — 1, e^s, s = dim V^, . . . ,dim2Vs; — 1, etc are likewise 
orthogonal.) We shall call 

ens, s = 0, . . . ,m«;dim\4 - 1, k e , (2.46) 

the i^'-adapted basis of For operators F G L^-^Af) the components with respect to 
an orthonormal basis {e,, i G N}, and its dual {cj = (cj, « G N} are Fij := ei{Fej), 
so that F = ^j^. CiFijCj. In the i^-adapted basis these become Fks,k's' = ^ksiFe^is')- 

In view of ()2.44j) one has to decompose the representation p x 1\k x Ij^ oi G x K m 
order to decompose F^iG x J\f) = L^{G) (g) L^{Af). Since the group that is represented 
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is really only G x K, the second tensor product should be read as an inner one; however 
for our analysis it is convenient first to regard it as an outer one too: combining ()2.42|) 
with ()2.45|) gives for the first factor 



pxi\ 



K 



(2.47) 



For the second factor we write 

£^ = , L\N) = niM^LliN) , (2.48) 

K K 

where Ll{J\f) is the subspace of functions transforming irreducibly according to f{k^^n) = 
r^{k)f{n) and m_vk are some multiplicities. Combining ()2.47|) and ()2.48p results in 

L'iG) L'iM) = j dv{a) 0/:. ® m^\4 ® mMn'Ll{M) . (2.49) 

The Fourier coefficients transform according to 

(p X e\K X e.^){g,k,k')ij{a,n) = n^{g)ip{a,n){rf, x r^,){k,k') . (2.50) 

It remains to implement the condition (!) in ()2.43|1 . ()2.44j) . Since ilj{k~^g, k^^n) = 
(£|x x£_v)(^, k)4'{g, n) this amounts to considering now the inner tensor product l\K®C-j\f 
and projecting onto the singlet sector. The reduction of £|x ® produces in a first step 
a direct double sum over k, k' of terms of the form r^j ® r^^i with multiplicities irif^mj^f^i. 
In the next step we use that ® r^^i contains the singlet if and only if k = . The 
latter readily follows from the general result of [H IH] (described in Appendix A4) on the 
singlet content of a tensor product of two unitary representations. As a consequence 
the direct double sum in ()2.49|1 reduces to a single sum and one can check that the 
condition (!) comes out correctly: tp{a,n){rf^ x ri^){k,k) = ■il){a,k^^n)ri^{k^^) = tp{a,n). 
Viewed as functions of n alone the Fourier coefficients obey f{k^^n) = f{n)ri^{k) or 
f{kn) = fin)r^iky. 

Therefore, in order to go from L'^{GxAf) to L'^{Air) it is useful to consider the subspaces 
Llf.{J\f) of Ll-{Af) and L^-(A/')o defined in fl2.38|) . Here we interpret the elements of 
^o- ® as linear maps from \4 C to the trace in the inner product ()2.37p for 
generic Hilbert-Schmidt operators reduces to a trace on for operators with values in 
®Vfi,. In components 

TryJ/i(n)V2(^)] = J^/i(^)L/2(^)«s, f{n) = /(n)i«,e«, , (2.51) 

i,s i,s 
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where Cj, i G N, is a basis on Lfj and e^s, s = 0, . . . , dim V^ — 1, is a basis of linear 
forms on Kt- The space L\fiJ\[^ carries a unitary representation tTo-k of G x iiT, 

T^uhig, k)f{n) := TT^{g)f{n)r^{ky , 

TrvJ[7r.,(^7,fc)/iH]t7r.,(^,A:)/2H] = TrvJ/iHt/2(n)]. (2.52) 

Note that the product '^a{g)f{n) still transforms nontrivially under the left diagonal ac- 
tion of K according to T^a{,g)f{jn) i— >■ 7T„{kg)f{kn) = n„{k)[n„{g)f{n)]rf,{k~^). However, 
introducing as the orthogonal projection from L'^{G) onto the subspace transforming 
according to k, traces of the form TivJ[PK'^(T{g)f{ny\ are invariant under the left diagonal 
action of K. 

Finally we arrive at the desired decomposition of L'^{M.r) into a direct integral of irre- 
ducible spaces 

L\M,) = I dv{a) mM'.Ll-,{M)o, (2.53) 

J Gr cy 
K&Kcr 

for some multiplicities iriMk- The representation p itself has been decomposed into a 
direct integral of primary representations (that is, pj|, p. 206, ones which are direct sums 
of identical copies of some irreducible representation). Here p acts as the right regular 
representation of G on the first argument of the functions L'^{M.r)i p{go)'ip{g,n) = 
ijj{ggo,n). The left K invariance of the functions is broken up into the different k 
'channels' on the Fourier coefficients; generic left K invariant functions are built from 
simple ones. Consistency with the initial decomposition ()2.4()|1 fixes the multiplicities 

rriMK = m^, , (2.54) 

where are the multiplicities occuring in the decomposition of TTalx, see ()2.45j) . In- 
deed, disregarding the breakup into the irreducible k channels the fiber spaces have the 
following isometric descriptions 

(2.55) 

where we used ()2.38p in the first isometry and inferred ()2.54|) from the required match 
with (A/-) ^C,®t^® L\M). 

The significance of the breakup into the irreducible k channels can be seen more clearly 
by identifying the pre-images of the functions in J dvi^a) mj^f^L'^^f.^N)^ with respect to the 
isometry ■?/' i— on L^(G x J\f). Here we take Llp.{N') to consist of the zero vector only, 
if K ^ Kfj- Roughly, the pre-image consists of functions invariant under left convolution 
with the character of k G Specifically we set 



{E^> * ilj){g,n) := rf^/ J dkxK'{k ^)ilj{kg,n) , 

LliMr) := G L\Mr) I E,, * ijj, = 5,,,^,} . (2.56) 
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The properties of the functions in this subspace are summarized in the following Lemma. 
Lemma 2.1. (a) Foripa G Lj.{Air), the Fourier coefficients obey 

. — ^ f for k' ^ K , 

^-p-, = <^ _ J ^ ^ ^2.57) 

\ i)f, e Ll-,{M)o for = 

In terms of components with respect to the K-adapted basis \2.4(^ this is equivalent to 
inkier, n)^^s^,K2S2 = /k(?^)«isi,s25k«2, with G L2-(A/')o. 

(b) For ipa E V n L?(A^r) (i-e. g ^ ipii{g,n) is smooth in g with compact support) we 
have 

■ipnig, n) = du{a) Try. [Pf,7T^{g) 4jf,{a, n)] . (2.58) 

(c) For (pa, ipa G L\{A4r), a Parseval identity holds 



j dgdn(j)ii{g,n)*ilJii{g,n) = du{a) / rfnTrfe(cT, n)'fV^«,(cT, n)] . (2.59) 

Proof, (a) We compute (i^^ * il)){g,n) by inserting the Fourier decomposition ()2.33|) for 
^Ij G L'^{Mr)- This gives 



{E^*ilj){g,n) = / du{a) Tr ilj{a,n) d^ dkxn^k ^)Ti^{k) n^^g) . 

= fdiy{a)TTy^['K^{g)^{a,n)P,]. (2.60) 

In the second step we identified the K integral as the projector ()A.14|) onto the mi^V,^ sub- 
space of £o-. This shows V'k-Pk' = ^Kn'i'k, or in components with respect to the if-adapted 
basis ipf,{a,n)^^si,K2S2 = fk{n) ^^81,32^^^2, with G Ll-^{N')o. The equiyariance property 
in the definition of L'^f.{N')Q follows from ()2.43p and ^{a, kn)Pf^ = tlj{a,n)TT„{ky Pf^^ = 
tp{a,n)Piirf^{ky . The fact that f^ is square integrable in the norm ( , )o-k follows from 
the Plancherel identity ()2.58p . 

(b) Eq. ()2.58|) follows from ()2.60p and the definition of L|(A^r)o- Note that the trace is 
constant on the equivalence classes {g, n) ~ {kg, kn), although the product Ti„{g)ipf,{a, n) 
itself transforms nontrivially under {g,n) {kg, kn). 

(c) This follows from (a) and ()2.36p . □ 

We add some comments on Lemma 2.1. First, in view of ()2.53|) the result can be 
summarized by stating that the map ipf^ ^ ipk in (j2.58p provides a partial isometry 

Ll{Mr) idu{a)mMkLlf,{M)^. (2.61) 

J Gr 
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Next we discuss two special cases, where in the decomposition ()2.58j) only "class 1" 
representations occur (i.e. representations which contain a vector invariant under the 
action of the subgroup K). The first case is that of p{K) singlets in L'^{Aij.)- In the 
decomposition ()2.33j) functions obeying ilj{gk,n) = ilj{g,n) are characterized by Fourier 
coefficients with PQ^{a,n) = V^((T, n), where Pq is the projector onto the singlet sector 
('k = 0'). In this case Eq. ()2.33|) reduces to 



^{gK,n) = fdu{a)Poma,n)7T,{gK)] (2.62) 
Jg/k 

Poi^{a,n) = [ d^G/K{9K)tlj{gK,n) Po7T^{K-'g-') . 
Jg/k 



Since the the functions g ^— ^ PQn^{g) are left i^-invariant by definition only 'class 1' 
representations (with respect to K) occur in ()2.62|) . Specifically, consistency with the 
harmonic analysis on Q = G/K requires that only those (class 1) irreducible represen- 

tions occur which enter the harmonic analysis on G/K. We have written G/K C Gr 
for this subset; as described in Appendix A. 7 it contains the spherical principal series 
representations only. 

For Fourier coefficients obeying in addition ()2.43|1 the projection PQ[ilj{a,n) 7rcr{gK)] is 
invariant under {g, n) {kg, kn). In this case the functions in ()2.62j) define a subspace 
of L'^lAir)- Note however that it is not p{G) irreducible; the latter requires Fourier 
coefficients satisfying Po'(p{a,n)PK = PoTpi^a^n) for some n E K. To proceed recall that 
the section gg : Q ^ G provides an injective imbedding of Q in G. We set 

■= Pf.7rAgs{q))Po , E,~M^ = Po7r.((?,(g)-^)P« , 
^k{q^ n) := i)k{gs{q)~^,n) , (2.63) 
in terms of which the expansion ()2.58|1 takes the form 

ilJk{q,n) = / du{a)TY[E^^ii{q)tpf,{a,n)] , 

Jg/k 

£(a,n) = [ d^Q{q)Mq,n)E^,f,{qy . (2.64) 



Another subspace of L'^{Air) in whose decomposition only class 1 irreducible representa- 
tions appear is the singlet (k = 0) sector of ()2.53|) . On account of Lemma 2.1 this sector 
arises from functions ipo ^ -^o('^r), that is, functions obeying ^ipoi^g, k~^n) = ipQ^g.n) = 
%l)o{kg n) . The Fourier decomposition takes the form 



'ipoig^n) = / diy{a) Po[7T^{g)ilJo{a,n)], 

Jg/k 

iljo{a,n) = tpo{a,n)Po= dg ipo{g,n)'K^{g'^)Po . (2.65) 
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We can now summarize the results on the group theoretical decomposition. Since the 
action of p{G) on L'^{M.^) corresponds to the original action of G on L'^{M.) (not 
to be confused with the left regular representation of G on itself denoted by tj we 
have found the desired group theoretical decomposition ()2.10|) : only a subset of G, the 
restricted dual Gr appears, and each a E Gr occurs with infinite multiplicity dim {Co). 
The measure d^ij^ is the Plancherel measure on Gr and the copies are counted with the 
counting measure on K. We continue to use the realization L^(Alr), where the group 
acts via the right regular representation on the first argument of the functions ijj = ipr- 
For convenient reference we collect the results in: 

Proposition 2.2. (a) The Hilbert space L^{Air) decomposes under the action of the 
unitary representation p{G) according to 

L\Mr) = i dv{a) m,Ll^{M), =: / dv{a) Cl{Mr) , (2.66) 

with L"^ f^{Af)o defined in \2. ,'/<^) . and the multiplicities in \2.4^ . 

(h ) Disregarding the breakup into irreducible k, channels the fiber spaces have the following 

descriptions 

^liMr) = m,Ll,{^)o = Ll,{U), C Ll,{U) ^C^®C,® L\U) , (2.67) 
with Ll-{Af) defined in (fOTj ). 

(c) On the subspace of L'^^Ai^) containing a p{K) singlet the decomposition has support 
only on the spherical principal series representations. 

The content of Proposition 2.2 can be illustrated by matching ()2.66|1 against a direct 
decomposition of L'^{Ai) ~ L'^{Q)®'^ into irreducibles. From ()A.26|1 one has 

L\Qr^ Z^^...^^/:.,®.. (2.68) 

J \c[uji)\^ \c[^^i)\ 

where ,uj E Q C R"^™^ carries the spherical principal series represenation vr^j^o- The 
decomposition problem essentially amounts to decomposing arbitary tensor products 
(8> . . . (S> Ci^^ of spherical principal series representations. This can be done inductively 
by first decomposing C^-^ C^^ = J dfi^ui, uj2\o')Ca, then C^^ C^^ for any a G G in the 
support of the measure dp{uJi,uj2\o'), and so on. Depending on what is known about the 
support of dfi{uJi,uj2\cr) in G this strategy requires knowledge of large portions of the 
complete branching rules. Since the complete branching rules are known only for a few 
noncompact groups (like SL(2,]R), see |^) this would be tedious, to say the least. 
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Information about the support of the measure dfi{u!i,U2\cr), seems to be available only in 
a few cases, like SOo(l, A^) from ^Tj. According to Theorem 10.5 given there, a tensor 
product of two spherical principal series unitary irreducible representations (UIR) of 
SOo(l, A^) decomposes into principal series UIR only, for A^ > 4 even. (For A^ odd this 
holds trivially and for A^ = 2 it is manifestly not true, see For more than two tensor 

copies (or for N = 2), however, the result is insufficient to exclude the occurrence of UIR 
other than principal series representations. For u = 3 one would need to know how the 
tensor product of a spherical and a generic (non-spherical) principal series decomposes. 
This might include discrete series representations and possibly others. So, for the direct 
decomposition of u > 4 fold tensor products of the spherical principal series, one needs 
to know essentially the complete branching rules. 

As a spin-off of Proposition 2.2 we have 

Corollary 2.3. (a) Let L^^ ® . . .® L^^ he an arbitrary tensor products of spherical prin- 
cipal series representations. Then for almost all ui, . . . ,uj,^ with respect to the measure 
in \2. 6'(S|) its decomposition does not contain the singlet ( as the only finite dimensional 
UIR). (b) Let Q{uJi, . . . ,u!^\a){qi, . . . ,q^) be an intertwiner from C^^ ® . . . ® C^^ to C„, 
a E G. Then, for almost all uji, . . . ,uJi, 



unless a is again a spherical principal series representation. 

Part (a) generalizes a result by Fulling ^16j for tensor products of spherical principal 
representations to all reductive linear Lie groups. Part (b) provides a nontrivial 'sum- 
rule' whenever explicit expressions for the interwiners are available. The 'almost all' 
caveat is needed because the Harish- Chandra c-function defining the measure in ()2.fi8j) 
is a meromorphic function over the complexification of Q (viz a^, where a is the Lie 
algebra of the subgroup A in the Iwasawa decomposition.) See e.g. j21]. Chapter, II. 3. 
At the position of a pole the decomposition ()2.68|) yields no information about the fiber 
spaces, but otherwise all spherical principal series representations occur [21], Chapter 
VI. 3. The location of the poles of c can be analyzed from the explicit expressions 
which could be used to specify the exceptional sets. 



3. The spectral problem on the invariant fibers 

We proceed to study the consequences of the orbit decomposition for selfadjoint opera- 
tors commuting with the group action. It is natural to consider the same class of integral 
operators as in Definition 2.1, but drop the positivity requirements. 




(2.69) 
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Definition 3.1. A standard invariant self adjoint operator A on L'^{Ai) is an integral 
operator with a symmetric continuous kernel A : Ai x A4 ^ C, which obeys A3. 1]) 
below and satisfies A{d{g)m, d{g)m') = A{m,m') for all g E G, m,m' & Ai. Its image 
o Ao<|) under the isometry in h2. is also denoted by A and is an integral operator 
on L'^{Mr) with kernel A : G y. J\f y. J\f —> €. , subject to \3.4^ below and \S.1\) . Here 

sup / dm'\A{m,m'\ = sup / dn'dg \A{g,n,n')\ =: Kj^ < oo . (3.1) 

m J n J 

As in Definition 2.1 the condition ()3.1|) entails that A is well-defined as a bounded 
selfadjoint operator from to for all 1 < p < oo. The structure of the kernels A and 
A of course implies that the operators A commute with iM^G) and p{G), respectively. 



3.1 Basic consequences of the p{G) invariance 
As a first result we have: 

Proposition 3.1. (a) Every standard invariant selfadjoint operator A on L'^{Ai) has 
purely essential spectrum, Spec(A) = ess-Spec(A). 

(b) A transfer operator commuting with ij^ (G) cannot have normalizable ground states; 
hence ||T|| G c-Spec{T), or ||T|| is a limit point of eigenvalues of infinite multiplicity. 

Proof, (a) Recall from Eqs. ()2.1()j) and ()2.11|1 that the measure /x^^ on G defining the 
decomposition of the unitary representation ij^ is related to that defining the generalized 
eigenspaces of A by ^g^^^f^^-^ dp{X, a) = dpij^{a). By Proposition 2.2 the measure pij^i^a) 
can be identified with the Plancherel measure. For the noncompact Lie groups considered 
the support of the Plancherel measure contains only infinite dimensional representations 
(see Appendix A). Therefore, whenever a generalized eigenspace £\,a{A) occurs in ()2.4j) 
its spectral value A has infinite multiplicity. This excludes that A lies in the discrete 
spectrum of the operator; hence A G ess-Spec(A). Note that it is not excluded that 
A has point spectrum of infinite multiplicity, i.e. infinite multiplets of normalizable 
eigenf unctions for some spectral value A. 

(b) Let now T be a transfer operator on LF'^M) commuting with ^J^^{G). Assume it 
has a normalizable ground state, i.e. a solution of Tip = ||T|| ip, with ip G L'^{Ai). By 
a well known result, based on the Perron- Frobenius theorem (see for instance PHIIS]), 
this ground state would be unique and therefore invariant under the action of £m{G), 
i.e. an ij^^ singlet. This entails that diverges as the infinite volume of the group 

is 'overcounted'. Thus ||T|| cannot be a eigenvalue. By part (a) it can also not be a 
limit point of the discrete spectrum (since there is none), leaving only the possibilities: 
||T|| G c-Spec(T) or ||T|| a limit point of eigenvalues of infinite multiplicity. □ 
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To proceed, let us momentarily denote the selfadjoint operator A in the realization 
acting on L'^{Mr) by := o A o $, with $ as in ()2.32|) . We write Ar{g, n, g', n'; t) 
for the corresponding kernel. Writing out ($^^ o A o $ ilJr){g, n) one finds 



Arig,n,g',n') = A{r\9,n),r\9',n')) = A{g'g-'q\g'g~\q\n') . (3.2) 



In the last step we used the invariance of A, i.e. d-M-id) o A = A o Ij^id) fo^' 9 ^ G. 
Since A* = o A* o $ for t G N, also all iterated kernels will be related by ()3.2j) . 

For the reasons explained in Section 2.3 the kernel A^ is most useful. From the last 
expression in ()3.2|1 one sees explicitly that Ar only depends on the right invariant combi- 
nation g'g"^, consistent with p{g) o A^ = A^ o p[g) for the operator. Further Ar is man- 
ifestly constant on the left equivalence classes {kg, kn) ~ {g,n) and {k'g', k'n') ~ {g',n') 
with {k, k') e K X K. We set 



We may thus interpret A^ either as an integral operator acting on L'^{A4r) or on 
L^(G X A/"); in the latter interpretation it automatically projects onto the iriK) in- 
variant subspace (with ir defined in ()2.3H) ). This means that the nonzero spectrum of 
A lies automatically in that subspace. For convenience, we will therefore work with this 
interpretation of A,,. 

To simplify the notation we drop the subscript r in the following and write A for A,, 
etc. Due to the properties ()3.3p . ()3.4|) A respects the fiber decomposition ()2.66|) in the 
following sense: 

Lemma 3.1. Let H be a measurable subset of Gr, S'^ its complement and let Ti and 
T-C^ be the corresponding subspaces of LP'{G) (which are orthogonal complements of each 
other): 



■A{gg' \ n, n'; t) := Ar{g, n, g\ n'; t) , 



(3.3) 



and note 



A{g,n,n') = A{g \n',ra) , 

A{kg, kn, n'; t) = A{g, n, n'; t) = A{gk~^, n, kn'; t) , k E K . 



(3.4) 





(3.5) 



Then kH^U and AH" C H". 
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Proof. Let ijj G H, ipc ^ 'H'^ and consider 

s{g) := Ap{g)i;) = {p{gY'^,, A^) . (3.6) 

The first expression shows that the Fourier transform s'of s is supported in S. On the 
other hand, the second expression shows that the Fourier transform is supported in S*^. 
This is possible only if s vanishes identically. Putting g = e, the lemma follows. □ 



3.2 Fiber decomposition of invariant selfadjoint operators 

In view of Lemma 3.1 the operator A should also map the fiber spaces C'^{Air) in 
()2.fi7|) onto itself. To give precise meaning to this statement we have to construct fiber 
operators A(cr) from A. In a first step one applies the expansion ()2.33|) to the kernel 
A{g,n, n') 

A{g,n,n') = / diy{a)Tr A{a,n' ,n)Tc„{g) . 

A{a,n\n):= dg A{g,n,n')n„{g'^) . (3.7) 
Jg 

The swapped order in the (n, n') arguments was chosen in order to have 

A{(T, k n , k '^)kisi,k2S2 ~ ^ ] f^Ki )sis A{(T, n , n^-^^g^i^^s' {^)s's2 ? (3-8) 

ss' 

where the indices k,s etc. refer to the /^-adapted basis ()2.4(i|l . Note further the her- 
miticity and diagonal K invariance imply 

A{a, n', n) = A{o-, n, n')^ , Trv'^^(cr, kn' , kn) = Try^^(cr, n' , n) . (3.9) 

Since by 1)3.11] for a.e. n, n' the kernel A is in L^{G), its Fourier transform A{cr, n, n') is 
a compact operator on C„ for a.e. n,n', see [T3], Theorem 7.6. Moreover ()3.ip implies 
the following bound on A{a, n, n') 

sup I dn\\A{a,n,n')\\ < Ka , (3.10) 

n J 

where || . || denotes the operator norm on C^r- If we momentarily introduce the spaces 
Ll{M) ■.= {ij:M^C,\!dn (^(n), ij{n)Yj' < oo} , (3.11) 
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it follows first that A{a,n,n') defines a bounded linear operator from L\{J\f) to L\{N') 
as well as from L'^{J\f) to L'^{Af); by complex interpolation it follows then essentially as 
in jSU] p. 173 ff that A{cr, n, n') defines a bounded linear operator from L^^{M) to L^^{N') 
for all p G [1, C)o], where the p = oo norm is given by sup„ a/ {ilj{n),i/j{n))a- 

Furthermore the projection property of A onto the ir{K) invariant subspace translates 
into an equivariance property analogous to ()2.43|1 : 



A{a,n',k~^n)7T^{k~'^) = A{a,n',n) = 7r^{k)A{a,k ^n',n) , for keK, (3.12) 

using ()2.34|1 . ()3.4|) . ()3.7|1 . In the following we wish to convert the action of A on L'^{Air) 
into an action A(cr) on the fibers J'^du^a) Ll{Air) such that Ailj{a,n) = A(cr)^(cr, ra) 
holds. To this end we note 

{Aij){g,n) = [ dg'dn'A{gg'-\n,n')ij{g',n') . (3.13) 



From the definitions ()2.33|1 one readily computes 

Aip{a,n) = dn ipi^ajn) A{a,n ,n) . (3-14) 



Note that A acts from the right on tp; it acts only on the factor ® L'^{N'). If one 
views as a matrix, the 'column' index is unaffected. 

We can now define the fiber operator A((t) by this action from the right, Eq. ()3.14j) . on 
the elements of L^-(A/') introduced in ()2.37|1 : 

A{a)^{a,n) := Aj((T,n) ; (3.15) 

the fiber operators A (a) then form a measurable field of operators such that 

A= diy{a)A{a). (3.16) 

The spectrum of A (a) has infinite multiplicity because of the spectator role of the first 
tensor factor: we have 

A(fT) = I®A^, (3.17) 

where Ag- acts on 'from the right'. This means that Ag- maps the space of bounded linear 
forms on with values in L'^{J\f) into itself, or equivalently, it is a map from £g®L^(A/') 
into itself. Thus Ag- is the (partial) dual of an operator A^- mapping L'^{M) into 
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itself. We will see that in many cases the spectrum of A^- has only finite multiplicity. 
As will become clear below, however, both A (a) and A^- in general mix the different n 
channels in the decomposition ()2.53|) . 

Since A is a bounded operator, it follows from general considerations (see [T3] (7.30)) that 
A(cr) : Ll^{Af) — > Ll.^{Af) is a bounded operator for almost all a (see also Proposition 
3.4 below). Similarly A^- is a bounded operator L'^{J\f) — »• L'^{Af) for almost all a, with 
L^(A/') as in ()2.39b ) of Definition 2.2. On this space the left action ir{K) corresponds 
to f{n) f-^ TXcj{k)f{k~^); the singlet subspace of L'^{J\f) under this action is just L^(A/')o 
as defined in ()2.39b ). 

Whenever A{a) and hence Ao- are bounded operators we call a G Gr nonexceptional. 
This is the case for all a in the discrete part of the restricted dual (see Proposition 
3.4 below) and for almost all a in the remainder Gr\Gd- Whenever a does not occur as 
an integration variable we will assume it to be non-exceptional. 

Let us now describe the operator A^. explicitly. In terms of the operator valued kernel 
A, its action is given by 

iAJ){n) = j dn' A{(T,n',n)^f{n') = j dn' A{(T,n,n')f{n') . (3.18) 

The equivariance property carries over to 

{AJ)ikn) = 7T^{k){AJ){n) , (3.19) 

or, in the i^'-adapted basis {Aaf){kn)^s = '"k(/^)ss'(Ao-/)(?t-)ks'- This is true whether 
or not / satisfies the corresponding equivariance property; it is a reflection of the fact 
that A projects onto the ir{K) invariant subspace of L'^{G x A/"). 

Proposition 3.4. Let A be a standard invariant self adjoint operator on L'^{A4r) the 
sense of Definition 3.1. Then: 

(a) The operator A has a decomposition A = di'{a){l® A^r) , respecting the fibers in 
Proposition 2.2. Further A^- is well-defined as a bounded linear and self adjoint op- 
erator on Ll{Af) for all a E Gd and almost all cr G Gr\Gd (called non- exceptional) . 
The associated norms satisfy 

esssup||A^|| = ||A|| . (3.20) 

(b) \e ess-Spec{A)=Spec{A) iff for all e > the set {a e Gr\ S^>ec(A(cr))n(A-e, A + 
e) 7^ 0} has positive measure, where A(cr) = I® A„. Further X is an eigenvalue 
of A iff the set {a & Gr\ \ is an eigenvalue o/A((t)} has positive measure. 
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Proof, (a) The decomposition has been just explained; the boundedness a.e. as well as 
()3.20|) follow from the general theory of direct integral decompositions of operators (see 
jT^I or 133], Theorem XIII. 83). For the sake of completeness we sketch the argument: 

For all ip G L^{Mr) one has from (^3!^ and (j!rTK|) 



{A^){g,n)= / du{a)TT[A{a)ij{a,n)7r^{g)]. (3.21) 

Jdr 

The norm of Aip is related to that of A^/'(cr, n) by the Parseval identity ()2.36|) 

(AV',A^)=/ diy{a){A{a)i^{a),A{cr)i^{a)U , (3.22) 



with ( , )o-5- defined in ()2.37j) . Since A is a bounded operator the left hand side of 
()3.22|1 is finite, hence the integrand on the right hand side is finite i/-almost everywhere. 
The bound ()3.20|) follows by choosing sequences of ijj such that their Fourier transforms 
'ip{a,n) are becoming concentrated at a particular value a (see [Hj, Proposition 7.33). 
Further A (a) is symmetric and has a unique selfadjoint extension for a.e. a, which we 
denote by the same symbol. Since A(cr) = I® Ag., the same holds for the fiber operators 
A,. 

(b) The statements about the spectrum in general as well as the eigenvalues follow as 
in Theorem XIII.85 of [44J. □ 

From our analysis we have obtained the following: The Hilbert space L'^{Air) is resolved 
into the direct integral J® di'{a)Ca®C,cr®L'^{N'). Likewise A can be resolved into a direct 
integral A{a)dv{a) = J® 1^^ (g) A^. The fiber operators A^. are (z/ a.e.) selfadjoint 
and therefore have a spectral resolution, which leads to a direct integral decomposition 
of the spaces Ll{Af) as well as of A^- and A((t): 

LliM)o = J rf/..(A)/:L(A/') , 

A, = / d/i,(A)A l£2^(^) , (3.23) 

as well as 

CliMr) = I dfi^{\)C^0CUM), 

A(a) = j dfi^{\)\Ic^^cUM)- (3.24) 
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Combining these decompositions, we have 




(3.25) 



So we have identified the measure dfi{\,a) in ()2.4j) as du^cr) dji„{\). 



3.3 Relating the spectral problems of A and A^: compact 

Our goal is to analyze concretely how the spectral resolution of the fiber operators A^. 
relates to the spectral problem of A, including the construction of generalized eigen- 
vectors. At first we consider an important special case in which the kernel of A is 
'almost' square integrable implying that the fiber operators A^ are compact. Explicitly 
we require: 

(C) fdgdndn'\A{g,n,n')\'^ < oo, or equivalently Jg^-idq f dm\A{q\q,m)\'^ < oo. 

Here A{m,m') is the kernel of the original operator acting on L'^{A4) while A is the 
kernel of its image under the isometry in Proposition 2.1. Of course since A{m,m') 
is invariant it can never be square integrable in the proper sense, see Proposition 3.1. 
However (C) implies that the fiber operators are Hilbert-Schmidt for almost all a. 

Lemma 3.2. Let A be a standard invariant self adjoint operator as in Definition 3.1 
whose kernel in addition satifies condition (C). Then the fiber operators A„ and A(cr) 
are Hilbert-Schmidt for all a E Gd and for almost all a G Gc- These a E Gr are called 
non- exceptional. 

Proof. The Parseval identity ()2.36|) applied to A{g,n,n') gives 



The integral over n, n' of the left hand side is finite by assumption; that of the right 
hand side can be expressed in terms of the Hilbert-Schmidt norm of the integral operator 
A((t) and gives j (iz/(o")|| A((t)||2. Thus A{a) must have finite Hilbert-Schmidt norm for 
almost all a G Gr, as asserted. The equivalence to the second condition in (C) can be 
seen from ()3.2j) . In detail 




(3.26) 




(3.27) 
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In the second equality we used that the fact that the section Qs : Q ^ G provides a 
one-to-one correspondence between points in Q and right K orbits in G. By definition 
{q.1i gs{(h)i^) = (^1, 0.2-1 ■■ ■ 1v) = tT^ and the d'yQ{qi)dn — d^{m) integral just defines the 
iteration of the modulus of the kernel. □ 



The spectral problem for the fiber operators and A((j) is now trivial: these operators 
have discrete spectrum except for 0, which is an accumulation point of eigenvalues of 
finite multiplicity. All eigenvectors lie in the respective spaces, i.e. in L'^{N') for A^- 
and in L'^-{J\f) for A (a). Since A (a) is of the form I (8> a dense set of eigenvectors 
F : M ^ C„® Ci, exists such that F{n) is trace class (not just Hilbert-Schmidt as in the 
definition of L^^(A/'). The goal in the following is to 'lift' these normalizable eigenvectors 
of the fiber operators to non- normalizable cr-equivariant eigenfunctions of A. To this 
end the action of A has to be extended to functions outside of LP'{M.r)- Our Definition 
3.1 ensures that A can be extended naturally as an operator from L°°{M.,) to itself, 
bounded in the sup norm. In order to relate the eigenvectors of the fiber operators to the 
eigenfunctions of A (which will no longer be square integrable), we need a generalization 
of the Fourier transformation. 

In preparation we introduce two pairs of Banach spaces as follows: 
Definition 3.2. 



1,2 ._ 



L^'2(G' X N) := L\G) ® L^U) , 
L'^'^G X Af) := L°°{G) L\j\f) , \\t\\°°'^ :-- 



J dn{ J dg\(f){g,n)\) 
(in(sup \t{g, n)\Y 



1/2 
1/2 



Further, for a & Gr 



L\M,C{jOa)) :=[C:M^ C{Ca) \ J cin||C(n)||' < oo} , (3.28) 

where C{C^) is the space of compact operators on L^j and \\C{n)\\ is the operator norm. 
Similarly 

L\M, Ji(£.)) ■.= [F:M^ Ji{C,) I j dn\\F{n)\\l < oo} , (3.29) 



where J\{^L^) is the space of trace class operators on C„ and ||F(n)||i 
the trace norm of F{n). 

Denoting by ' the topological duals one has 

L°°''^{Af X G)=L^'2(G X Af)' 

L\N,MC,))=L\N,C{C,))' . 



TrflFfn)!! is 



(3.30a) 
(3.30b) 
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Of course the spaces are not reflexive, the double duals are much larger than the original 
spaces. The relations ()3.30p follow from the well-known facts L}{G)' = L°°{G) and 
C{Ca)' = j7i(£o-), see e.g. jlH], Theorem VI. 26, for the latter. Concretely one has 
\{t, 0)1 < t G (f) G L^'^. Thus (t, ■ ) defines a linear bounded functional 

on L^'^; moreover every such functional is of that form. Similarly, 



{F,C)^^= dnTT[F{nyC{n)]< dn\\F{n)\\l dn\\C{n)\\^ , (3.31 



1/2 



1/2 



SO that (F, ■ defines a linear bounded functional on L'^{Af,C{Ca))] moreover every 
such functional is of this form. 

The two pairs of spaces ()3.30b .b) are related by the generalization of the Fourier trans- 
form we are aiming for. To see this we introduce 

Definition 3.3. A function t = t^r & L°°''^{G x TV) is called a-equivariant for some 
a G Or, if there exists a E L'^{N ,C{Ca))' such that 

(t^, 0) = 4(0(a)) for all (f) G L^^\G x Af) , (3.32) 

where (f){a, n) is the Fourier transform \2. SS\) of (j) (which is C{Ca)-valued for ,n) G 
L^{G)). Such ta intertwine the right G action p on L°°{G) with that ofrca, i.e. 

{p{g-^%,<P) = UTX,{g)^) , (3.33) 

for all g E G and (f) G L^'^(G' x M). The a-equivariant subspace of L°°'^{G x Af) is 
denoted by C^'^{G x AT). 

Proposition 3.5. Every a-equivariant t^ G L°°''^{G x A/") is of the form 

t^{g,n)=TT[Fin)7r^ig)], (3.34) 

for a unique F G L'^{Af, Ji{C^)). Equivalently the map t^ : L^(A/', Ji{C^)) C'^''^{G x 
A/"), F t^ , is a bounded injection. The intertwining relation becomes tZ'^^^°^^ {g,n) = 
t^{ggQ,n). A substitute for the Parseval relation is 

(t^,0) = (F,0(a)).,, (3.35) 

for all(l)e L^'\GxX). 

Proof. We begin by showing that the map F{n) t^{ - ,n) is injective for almost all 
n e M. 
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Here we can appeal to a theorem due to Glimm fHl ^] that imphes that for a type I 
group (which we have here) the closure in operator norm of the algebra generated by 
^cr(fi')) 9 ^ G consists of all compact operators on C^j. Then if t^(0) = for all G T>{G) 
also Tr[F7ro-((7)] = for d\\ g E G and by the above mentioned theorem Tr[Fy4] = for 
all compact A, which implies F = 0. 

A slightly more down to earth argument goes as follows: Assume again that TrF7ro-(</)) = 
for all (p G V{G). Replacing by * * E^, we see that Tr[P^FP^/7r^(0)] = for 
all G 'D{G) and k, k'. Note that RanP^ = m^VK and RanP^ = uIi^iVk' have finite 
dimension. By a theorem of Kadison [2H] , the norm closure of the algebra generated by 
^cr(5'), 9 ^ G, contains operators that map any finite set of linearly independent vectors 
into any other given finite set of vectors of the same cardinality. This means that for 
any linear map L^'^k from m^K; to m^'K;' there is an element A in that norm closure 
such that = Pk'AP,^. Hence Tt[FLk',k] = for any such linear map, which implies 
P = 0. ' 

To complete the proof, let C G L^(A/', C(£o-))' be the element associated with via 
(Pn?^ . On account of ^Mp) there exist some F G L'^{M , Ji{C„)) such that 4(C) = 
(P"'',C)o-d- for all C G L'^{Af,C{Ca))- This holds in particular for C{a,n) = (f>{cT,n) for 
G L^{G) ® L?{N). A simple computation then gives £cr(0(c")) = (if) 0); with as in 
()H.H4|) . The uniqueness of F follows the above injectivity result. For the norm of one 
has ||t^|r'2 < {]dn\\F{n)\\lfl\ □ 

We add some remarks. Proposition 13 . 51 allows to give the space C'^''^{GxAf) the structure 
of a pre-Hilbert space by defining a scalar product 

(tf,tf):= I dnTr[F{nyF\n)] ; (3.36) 

and of course by completion this gives rise to a Hilbert space, which can be identified 
with L'^{Af,J2{Ca)), where J2iC^) is the space of Hilbert-Schmidt operators on C^r. 

Comparing ()3.34|) with ()2.33|) one sees that F can be viewed as the unique Fourier trans- 
form of t = t(j, but in a fixed a fiber (it is a '5 function' in Gr). The equivariance property 
()3.32|1 characterizes the fiber. Equivalently the cx-equivariant subspace of L°°''^{G x A/") 
can be identified with L'^{J\f, Ji^Ca)) by the bounded injection t„. The map can also 
be turned into an isometry by transporting the norm to its image. 

Since L'^{Af-, Ji{Ca)) carries the representation ti^ x tTo-, a G Gr, oi G x G, where (tTo- x 
Tra-){go, gi)F{n) = 71^(90) F{n)7ia{9i^), the intertwining property in Proposition 3.5 in 
principle generalizes to {n^ x 'K^){gQ, gi) t^{g,n) = t^{9i^ggo,n). However since we 
eventually are interested in functions on Air = {G x jV)/d{K), only left actions with 
gi = k E K are useful. 

Whenever F{n) satisfies the equivariance condition ()2.43|) the function t^{g,n) projects 
to one on A4r, i-e. t^{kg,kn) = t^{g,n) for k E K. We denote the left K invariant 
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subspace of L°°''^{G x J\f) by and the subspace of L^(A/', J7i(£<j)) whose ele- 

ments satisfy ()2.43|) by L'^{Af, J'i{C^))q. Proposition 3.5 evidently remains valid as an 
injective identification of L^{Af, J'i{C^))o with the cr-equivariant subspace of L°°'^{A4r), 
for which we write 

To proceed we now show that in addition to intertwining the group actions, the map to- 
also intertwines the action of A with that of A(o"). Indeed, using only the definitions 
(HTfj) . dniSl), (HOil) one computes 

[At^]ig,n) = jdn'TT[Fin') Aia,n',n)n^{g)] 

= Tr[(A(a)F)H7ro(^)] =t^(-)^(^7,n). (3.37) 

If the Fourier transform were well-defined on these functions the relation ()3.37|) would 
amount to At^ = A{a)F, just as in ()3.14|1 . ()3.15|1 . The point of ()3.37j) is that it remains 
vahd for A acting on x A/") and A((t) acting on L^-(A/"). 

Since n ^-^ F{n) takes values in the trace class operators and the kernel A acts from the 
right one can expand F[n) into rank 1 operators of the form 

oo 

F{n) = Y,v,^Mn), (3.38) 

i=l 

with Vi G Ca and /j : A/" ^ £0- in L'^{Af). Mostly it is therefore the restriction of t„ 
to rank 1 operators F{n) = v ® f{n) that is needed and it is convenient to introduce a 
separate notation for it. We define 

T,^ : LliM) ^ C^^\G X Af) , f^rUf), (3.39) 
rUm.n) ■.= C^{g,n) = Ti[{v® f{n))ix,{g)\ = {f{n),7r^{g)v)^. 

Note that the map is antilinear in / but linear in /, and that t^{g, n) = Tvi<7{fi){g, n), 
for F of the form ()3.38|) . Whenever f is K equivariant the image function is left K 
invariant, i.e. ()3.39|) also defines a map r^o- : L^(A/')o £^'^(A^r)- It is straightforward 
to see that the map is bounded in the norm || ■ ||°°'^. It is thus a bounded injection 
and can be made into an isometry onto its image by transferring the norm to the image. 
The representation tTo- acts on rank 1 valued operators merely by rotating the reference 
vector: v®f{n) t-> {t^ a{go)v) ® f {n) , so that T^a{f)iggo^) = r^„(go)i>,a(/)(fl'^J^^ Further 
r^o- interwines the action of A and A„: either from ()3.37p or directly from ()3.13|) . ()3.18p 
one finds 

(Ar^,(/))(^,n) = {A^f„{n),7r^{g)v)„ = {T^^{AJ)){g,n). (3.40) 

This intertwining relation now allows to reduce the spectral problem for A to the simpler 
spectral problems of the fiber operators A^- in the decomposition A = J®(iz/(cr)(I(8) Ag-). 
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We write 

SxA-^) = {^aE C'^^'^iMr) is eigenfunction of (3.41a) 

A with spectral value A G Spec(A)| , 

^a(A^) = |xa G Ll{Af)o Xa is eigenvector of (3.41b) 

Ao- with eigenvalue A G Spec(Ao-)| , 

and similarly for ^a(A^) C LI{M) and ^a(A((t)) C L'^{M , Ji{C,))o. 

The space £a,ct(A) inherits the pre-Hilbert space structure from C^''^{M.^) and we denote 
its completion by £^a,o-(A), whereas £^a(Ao-) is already a Hilbert space. 

The relation of these spectral problems is described by 

Proposition 3.6. Let A he a standard invariant self adjoint operator on L'^{Air) in the 
sense of Definition 3.1 and assume that its kernel satisfies in addition condition (C). 
Then the fiber operators A(cr), A^. are Hilbert- Schmidt for all non- exceptional a E 
by Lemma 3.2. Further for these a E Gr 

(a) For each v E the map r^o- : i^A(Ao-) £^a,o-(A) is a bounded injection. 

(b) If Act, cr G Gd, has an eigenvector (normalizable eigenfunction) for some X, the 
associated generalized eigenfunction in (a) of A is normalizable (i.e. A is an eigen- 
value of A of infinite multiplicity). 

(c) A complete orthonormal set of eigenf unctions of A{cr) in Sx{A{cr)) is given by 

[ei^Xxar] ; (3.42) 



a complete orthonormal set of eigenfunctions A in £^a,o-(A) is given by 

{^e,<T(XAar)(^,n)| , (3.43) 

where Xxm- runs through an orthonormal basis of Sx{A„) and Ci runs through an 
orthonormal basis of C^. The eigenfunctions \3.43{ ) vanish pointwise for g oo 
(i.e. as g leaves any compact subset of G). 

8\^a{A) and £\{A{a)) are isometric as Hilbert spaces. In particular the spectrum 
of A{a) is contained in the spectrum of A for almost all a G Gr. 
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(d) An orthonormal basis of Ll{Af)o is given by 



Xx.r\ , (3.44) 

where Xxur runs through an orthonormal basis of £x{A„), and A runs through the 
eigenvalues of A^. An orthonormal basis 0/ L^(A/', i72(£o-))o is given by 

Ci ® XAar} , (3.45) 

where in addition Ci runs through an orthonormal basis of C^j. 

(e) The set of all eigenf unctions [J^^S\^(j{A) is complete in the sense that for each 
(f) € {L'^ n L^){A4r) the following Parseval relation holds: 

(0,0)= / c/z/((j)c//i<^(A) ^ / c/n] (xAar(n),0((T,n)ei)^|^ , (3.46) 

i,r 

where the measure dfia{\) introduced in ( !,'/. here is just the counting measure 
of the eigenvalues A of A„. 

Proof, (a) Since A^. is selfadjoint, we can assume that A is real. Clearly, if x ^ ^x{-^a), 
i.e. A^x = Ax, then Ar„^(x) = r^^i-^^x) = Ar„^(x), i-e. r^aix) ^ ^xA-^)- % Proposi- 
tion 3.5 the map 8\{A(j) 3 x ^ '^'vaix) ^ ^a,o-(A) is injective. 

(b) Recall from P, Theorem 14.3.3, that the coefficients of a square integrable repre- 
sentation TTg-, 0" G Gd, satisfy, using the i^T-adapted basis ()2.46j) 

J dg7l^a{9)KiSi,K2S2^'^(9)K3S3,K4S4, — '5k1K3'^SiS3'^K2K4'^S2S4 5 (3.47) 

where is the formal degree of 7t„. Let x ^ L'^i-^) be the normalizable eigenfunction 
of Ao- for some a G Gd, and consider the associated generalized eigenfunction Ty^{x) of 
A. Using ()3.47j) one can verify by direct computation that 



d^j dgdn\T^^{x){9,n)\^ = {v,v)^{x,x)a , (3.48) 

holds. It follows that Ty„{x) is actually normalizable, i.e. an element of L'^{A4r) H 
£^'^(A^r)- For the spectral values this implies: if A G d-Spec(Ao-) then it is an eigenvalue 
of infinite multiplicity of A. 
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(c) ()H.42|1 follows directly from the completeness of the eigenfunctions of Ao- and the 
relation between the operators A (a) and A^. The second statement follows from the 
fact that all the functions in S\^^{A) are cr-equivariant and hence by Proposition 3.5 
of the form Qcr{g,n) = Tr[F[n)7rcr{g))]- The eigenfunction condition translates into the 
condition that F is an eigenvector of A (a) with eigenvalue A; a complete set of such 
eigenvectors is given by ()3.42|1 . as we have just seen. By construction the map F ^ 
preserves the scalar product, which implies the orthonormality of the set ()3.43|) . So 
provides an isometry between £>,,o-(A) and £\{A{a)). The vanishing at infinity in G 
of the eigenfunctions ()3.42|1 follows from the Howe- Moore theorem, see jHO], Theorem 
2.2.20. 

(d) This follows from the spectral theorem applied to Aa- and A (a) together with part 
(c). 

(e) Since (p & L"^ (1 L^, its partial Fourier transform (f){a,n) is a.e. a Hilbert-Schmidt op- 
erator in C(j. The statement then follows from the completeness of the fiber eigenvectors 
(part (a)) and the Plancherel theorem of Appendix Al. □ 

We repeat a cautioning remark made in Section 2.2: the fact that Aq G Spec(Aa-o) for 
some (Jo and hence £^Ao,o-o(A) is nontrivial does in itself not imply that Aq € Spec(A). In 
fact there are explicit counterexamples. By Proposition l3.4b one needs a set S of nonzero 
Plancherel measure, such that for each neighborhood U of Aq we have IJctgs Spec(Ao-) fl 

In the case of compact fiber operators A^- we have however obtained the following 
relation between the spectral problems of A and A„: for every spectral value |A| < ||A|| 
of A there is an eigenvalue of A^-. The corresponding normalizable eigenvector x of 
Ao- generates a G orbit of eigenfunctions of A via t\,o-(x), and all cr-equivariant 
eigenfunctions of A arise in that way by taking linear combinations in x and the reference 
vectors v G C^. In addition there may be 'fake' solutions of AQ = XQ, where A ^ 
Spec(A). The value |A| = of course always belongs to the spectrum of A. 



3.4 Relating the spectral problems of A and Af^: A^r not necessarily compact 

The discussion becomes a little more complicated in the case of not necessarily com- 
pact fiber operators. These naturally arise if the original kernel is not 'almost' square 
integrable as in condition (C). In this section we require instead the weaker conditions 

(CI) sup^ fdm'\A{m,m')\'^ < oo , 

(C2) There is an invariant multiplication operator M given by a d{G) invariant func- 
tion in L'^{A4) also denoted by M, such that M~^AM defines a bounded (invari- 
ant) operator on L'^{A4). 
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For a positive kernel A{m,m') > the condition (CI) amounts to sup„A(m, m;2) < 
oo, which is weaker than the integrabihty condition in Lemma 3.1 (at least as far as 
decay properties of A are concerned). The multiplication operator acts by {Mip){'m) = 
M{m)ijj{m), for ijj e L'^{Ai). Invariance M{d{g)m) = M{m), for all g E G, means that 
M maps into multiplication by a function M on A/", given by 

M{n) := M{q\n) (3.49) 

under the isometry : L^(A^) L'^{M.^) in ()2.32p . We drop the tilde and continue 
to write M G L'^{M) for this function and note that the kernel of M~^AM, viewed as a 
bounded operator on L'^[Ai^) is given by M(n)~^A{gg'~^, n, n')M(n'). The counterpart 
of Lemma 3.2 is now given by 

Lemma 3.3. Under the conditions (CI), ( C2) the fiber operators A^- have for all a E Gd 
and for allmost all a E Gc the properties 

(Cr) sup„ / dn'\\A{a,n,n')\\l =: Ga < oo, where \\-\\2 denotes the Hilhert- Schmidt 
norm for operators on L^- 

(C2') there is a function M G L?'{N') such that M'^A^M defines a hounded operator 
on L'^{N'), where M maps each L'^{Af) into itself via {M(j)){n) := M{n)(j){n) . 

The goal in the following will be to first gain control over the eigenf unctions A^. (a step 
which was trivial in Section 3.3) and then to lift them to tTo- equivariant generalized 
eigenf unctions of A. 

Proof (CI') follows from (CI) by applying (jT^ . (C2') is obvious. □ 

For the first step we will make use of the Gel'fand-Maurin theory of generalized eigen- 
vectors and eigenspaces, in particular of a version due to Berezanskii as described (and 
proven) in Maurin [HI]. Berezanskii's construction, applied to the present situation, 
requires to set up for almost each a E Gr a. triplet 

$.(Ar) c Lli^^) c Ki^f) , (3.50) 

in which $o- = $o-(A/') is the domain of an unbounded, densely defined closed operator 

whose inverse is Hilbert-Schmidt and $^ = ^^A^) is the topological dual of 
Choosing 

:= M-^A;! , (3.51) 

we compute 

TiLKM) [{B;y{B;'] < [ dndn'\M{n)M{n')\ \\A{a,n,n')\\l < \\M\\IGa , (3.52) 
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where in the last step we used property (CI)' and the fact that therefore \\A{a, n, n')\\l is 
the kernel of a bounded operator on Ll{J\f) with norm < Ca, see p. 176. This shows 
that is indeed Hilbert-Schmidt. Property (C2)' now guarantees that A^. maps 
into itself. Indeed from A^MLl{J\f) = MLl{Af) one sees that MLl{J\f) coincides both 
with the range of = A^-M and with the domain of B^r. 

$o- is a pre-Hilbert space with the scalar product 

(0, tlj)B ■■= (5.0, B^^P)^ + (0, V^). ; (3.53) 



we denote its completion with respect to the norm ||0(t||b := 1^(070X6 by $o- C L^(7V). 
The dual of A^r acting on $^ will also be denoted by A.. Berezanskii's theorem guar- 
antees that A. has a complete set of eigendistributions in We now proceed to show 
that in the situation at hand these are in fact almost everywhere defined functions from 
JV with values in C„ (which are of course not square integrable). More precisely we have 

Proposition 3.7. Under the conditions (CI) and (C2) above, for almost all a G Gr 
the fiber operator A. has a complete set of generalized eigenfunctions Xxar, where r = 
1, . . ■ g{X) with g{X) GNU {oo} denotes the multiplicity of the spectral value A. The 
generalized eigenfunctions satisfy for almost all A G Spec(Acr) 

(a) A^XXa = AXAa, 

(b) MxxaeLliU). 

(c) Forcjye MLl{J\f)o we have the Parseval (completeness) relation 

dn{(f){n),(f){n))^= dn diJ,a{X)^^{x\ar{n),(j){n))^ . (3.54) 

We denote the space of these eigenfunctions by £\{A(j). 

Proof. We first show that (the dual of) Ao- maps into almost everywhere defined 
functions from M with values in More precisely, for any x G 

M^A,X={B-')\eLl{M). (3.55) 

Since is a pre-Hilbert space, by the Riesz representation theorem each element x of 
can be represented by an element in This means that there is a ■0^ G $o- C L'^{f/) 
such that for all G 

|(X,0).| = \{^x,<P)b\ < UxhrnB. (3.56) 
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Replacing by 5- V, and using = (0, i?." V)<x < {l + \\B-'r)ml, 

gives 

< llV^xbll^^Vb <const||V^J|B||0|U. (3.57) 

This shows that B^^(f))„ defines a bounded hnear functional on the dense domain 
$o- C L'^{J^) and hence is given by an element of Ll{Af), as claimed in ()3.55|) . Now (a) 
and (c) follow from Berezanskii's theorem and (b) follows from (a) and ()3.55|) . □ 

Consistency requires that the dual of Ag- (with a separate notation only at this 
point) is such that MA'^M~^ is a bounded operator on L^(A/'), which is however just 
the relation dual to (C2)'. 

Let us add that it is not possible to apply this method directly to obtain the cx-equivariant 
generalized eigenfunctions of A itself. As long as A and M are invariant the product AM 
will never be Hilbert-Schmidt, as the infinite group volume is once more overcounted. 
One would have to replace the invariant multiplication operator M by an operator of 
multiplication by a (necessarily noninvariant) function in L'^{Air), which would make 
the strategy at least cumbersome. 

We rather proceed as in Section 3.3. In order to avoid having to introduce further 
notation we continue to use the spaces in Definition 3.2 but indicate the modified notion 
of square integrability by a mnemonic pref actor M or M~^. For example 

F eM-^L^{M,Ji{C^)) if j dn\M{n)\^\\F{n)\\l<oo, 

t e M~^L°^'\G X M) if [ dn\M{n)\'^ Slip \t{g, n)\^ < oo. (3.58) 

J a 

The a-equivariant subspace of M-^L'^^'^{GxN') is denoted by M'^ C'^''^{GxN'), etc. We 
define t^{g, n) := Ti[F{n)'K„{g)] as in ()3.34|) . With these modified spaces Proposition 3.5 
carries over, and states that every element of M~^£^'^(G x A/"), is of the form t^{g,n) 
with a unique F G L'^{N , Ji{Ca))- The intertwining property for the G actions is 
manifest and At^ = t^^^^^ carries over from ()3.37j) . Since F{n) is trace class we can 
expand it as in ()3.38j) 

F{n) = Y,Vi®Un), ViEC^, Xi^M-'LliAf), (3.59) 

i 

and define 

X'^TvM^ Tvaix)i9,'n') = {xin),TT^{g)v)^, (3.60) 
where again the spaces and their norms are defined in the obvious way. 
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In parallel to Eq. ()3.4H) we write 

£A,a(A) = e M-^C^'^iMr) is eigenfunction of (3.61a) 

A with spectral value A G Spec(A)| , 

^a(A^) = |xa G M~^Ll{Af)o Xa is eigenfunction of (3.61b) 

Ao- with spectral value A E Spec(Ao-)| , 

and similarly for ^a(A^) C M-^Ll{Af)o and ^A(A(a)) C M'^L^i^, Ji{C^))o. 
We obtain the following counterpart of Proposition 13.61 

Proposition 3.8. Let A and A(cr), A^- with a E Gr non- exceptional as in Proposition 
3.4, and assume that A satisfies conditions (CI), (C2). Then 

(a) '■ i^A(Ao-) £^A,o-(A) is a bounded injection. 

(b) A complete set of generalized eigenf unctions 0/ A(cr) in Sx{A{a) is given by 



ei ® Xxarj ; (3.62) 
a complete set of generalized eigenf unctions of A in £^a,(t(A) is given by 

{re^a{xxar){g,n)^ , (3.63) 
where X\ar runs through the complete set of Propostion \3. 7| and Cj runs through 



an orthonormal basis of Ccr- The eigenf unctions IIS. 6S\) vanish at infinity in G. 
£^A,o-(A) and £\{A{a)) are homeomorphic as Banach spaces, provided one uses on 
the image the norm transported from the preimage. In particular the spectrum of 
A(o") is contained in the spectrum of A for almost all o G G^. 

(c) A complete set of of generalized eigenfunction spanning L^(A/')o is given by 

XXar] , (3.64) 



where xxar runs through the complete set above and A runs through the eigenvalues 
of A„. A complete set of eigenfunctions spanning L'^{Af, J^2{'^a))o is given by 

jcj ® XAar} , (3.65) 
where in addition Ci runs through an orthonormal basis of ■ 
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(d) The set of all eig en functions |J^^ £^a,o-(A) is complete in the sense that for each 
(p G (L^ n L^){M.r) the following Parseval relation holds: 

(0,0)= / du{a)dfi^{X)^ / dn\[x\ar{n),(i){a,n)ei)j'^ , (3.66) 

i,r 

with the measure dficr{X) introduced in 2'^) . 

Proof. The proof parallels that of Proposition I3.61 The only change is that the com- 
pleteness of the set of eigenvectors has to be replaced by the completeness relation of 
Proposition 13.71 (c). □ 

Symbolically we can summarize the content of Propositions 3.6b and 3.8b in the isometry 

£x,M) - Sx{A{a)) . (3.67) 

That is, under the conditions (C) or (C1),(C2) the space of eigenf unctions of the fiber 
operator A (a) is naturally isometric to the space of cr-equivariant eigenfunctions of A. 
When A = T is a transfer operator and the spectral value is A = ||T||, the generalized 
eigenspace £^||t||,(t(T) = ^o-(T) is the cx-equivariant piece of ground state sector of T. 



3.5 Absence of the discrete series 

A priori the spectral value of A of the operator A is of course unrelated to the type a of 
(irreducible) representation with respect to which a generalized eigenfunction transforms. 
The goal of the Section 4 will be to show that for a transfer operator T and the spectral 
value A = ||T||, the possible representations cr e are severely constrained. A first 
flavor of the correlation between the spectral value of A and the type a of irreducible 
representations allowed can be obtained from the 

Corollary 3.1. Let A be as in Section 3.3 or 3.4 and A(cr) = 1® Ag- one of its fiber 
operators. Under any one of the following conditions the eigenspaces Sx^^i-^) — ^^a(A((j)) 
for a G Gd, the discrete series of G, are empty: 

(a) £\{A{(t)) contains a left K singlet, i.e. a generalized eigenfunction F obeying 
F{kn) = F{n), for all keK. 

(b) £\^a{A) contains a right K singlet, i.e. a generalized eigenfunction Vt obeying 
^l{gk, n) = Q{g, n), for all k E K. 

(c) A = T is a transfer operator, A = ||T|| and it is an eigenvalue ofT{a). 
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Proof. (a),(b) For definiteness let us consider the setting in Section 3.3, for the one in 
Section 3.4 only notational changes are required. Via the isometry F ^ the assump- 
tions in (a) and (b) amount to TT[F{kn)TT^{g)] = TT[F{n)TT^{g)] and TT[F{n)'n'„{gk)] = 
TY[F{n)na{g)], respectively, for all k E K, g E G and almost all n G Af. In terms of 
Pq, the projector onto the n = singlet subspace in this becomes TY[F{n)7i„{g)] = 
TT[F{n)Po'7ia{g)] and Ty[F {11)11 (j{g)] = TT[F{n)Tra{g)PQ], respectively. However these can 
be nonvanishing functions only if the projections PQ7r„{g) or 7[„{g)PQ are nontrivial, which 
requires tTo- to be of i^'-type 1. All i^-type 1 representations are however non-discrete 
(in fact spherical principal series) representations. 

(c) The proof is by contradiction. Let a E Gd he given and suppose that the point 
spectrum of is nonempty and contains ||T||. The spectral radius equals ||T|| and the 
normalizable eigenfunction Xa of T^- has eigenvalue ||T||. By Prop Klfil b) the associated 
eigenfunction Xyo-(xo-) of T is normalizable. This contradicts Prop. ITlT b). □ 

Part (c) of the corollary is useful because in many cases all the fiber operators T„ 
are compact (see Section 3.3). Then the nonzero spectrum of is discrete for all 
nonexceptional a. Parts (a), (b) are useful, because often one has independent reasons 
to expect that a ground state should exist, which is at least a singlet under a maximal 
compact subgroup K of G. In all cases the corollary entails that all discrete series 
representations are ruled out as candidates for the representation carried by the ground 
state sector. The remaining part of the restricted dual corresponds to noncompact 
Cartan subalgebras (see Appendix A. 2) and the associated irreducible representations 
are cuspidial principal series. To avoid having to discuss the restricted dual Gr of 
generic linear reductive Lie groups, we focus from now on on the case G = SOo(l,iV). 
Its representation theory shows all the typical complications (existence of discrete series, 
in particular) and one can reasonably expect that the subsequent results will generalize 
to other Lie groups. 
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4. The structure of the ground state sector 



For definiteness we consider from now on the case G = SOo(l, A^). The restricted dual 
then is a disjoint union Gr = Gd ^ Gp, of a set Gd describing discrete UIR (unitary- 
irreducible series representations) and a set Gp describing principal series UIR. A UIR 
(Td G Gd is parameterized a tuple of integers ±s G N, ,^ G Ms C M, a UIR CTp G Gp 
is labeled by a real parameter uj > and again by a tuple of integers C, G M. Here 
M is the dual of the subgroup SO(A^ — 2). We refer to appendices A and B for a brief 
survey of the relevant aspects of the representation theory of linear reductive Lie groups 
in general, and of SOo(l, A^) in particular. 

Recall from Section 3 that the space of a-equivariant ground states ^cr(T) can be iso met- 
rically identified with the eigenspace £^||T||(T(cr)) of the fiber operator T(cr) = 10 To-. 
The goal in the following is to successively rule out more and more UIRs a G Gr for 
which the fiber spaces in Qa{T) can be nonempty. This will lead to Theorems 1.1 and 
1.2, as announced in the introduction. 



4.1 ^cr(T) is empty for all but one principal series representation 

We begin by studying in more detail the restricted transfer operators T^^ := T^-, where 
we now write the label a as {uj,C,) corresponding to a member of the principal series 
(see Appendix B). We also denote by M the subset of Gr corresponding to the principal 
series. 

Here the realization of the model space C^^ as Lj{K) and the realization of the infinite 
sums over k in terms of fc-integrations is useful. See Appendix A. 8. We first show that 
in this realization the function space L^(A/')o in ()2.39j) . for which we now write L^{J\f), 
takes the following form 

feL'i^^xK,v^), 

f{kon,k)=f{n,kko), koeK, (4.1) 

f{n, mk) = r^{'m)f{n, k) , m E M . 

For fixed n E M the second equation is just the defining relation for L|(i^'), see ()A.43|) . 
The first relation is the realization of the equivariance condition under ir{K) in the 
compact model of the principal representation. Indeed the right action f{n,k) i— > 
/(n, k)ni^^{g) can be read off from Eq. ()A.56b ) and is given by 

f{n,k)7r^^{g) = {6u)-\a{kg-')) f{n, g-'[k]) . (4.2) 

For g = ko E K the right hand side of ()4.2|1 reduces to f{n, kk^^) so that the equivariance 
condition assumes the form given in 1)4.11) . As a check one can verify the left K invariance 
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f{kon, k)7i^^{kQg) = f{n, k)-n^^{g) , ko e K , (4.3) 

using a{kg^^k^^) = a{kg~^) and k^kg^^k^^) = k(kg^^)kQ^ via ()A.37|1 . 

The fiber operator T^^ will now act on the space of functions ()4.1|1 as an integral operator 
with kernel 

%^{n,n';k,k') := / dgT{g,n ,n)[7r^^{g)]{k' , k) 



using ()A.54|1 . Explicitly 1^ = 1^1^ and 6 are given by ()B.8|) . From ()3.4|1 and ()A.54jl one 
verifies the symmetries 



%^{kon,n';kkQ , k') = %^{n,n'; k, k') = %^{n, kou'; k, k'k^ ), 



(4.5) 



which ensure that T^^^ acts consistently on the function space ()4.H) . For fixed arguments 
the kernel ()4.4|) is a linear map on whose matrix elements obey 



{v,Zj^{n, n';k,k')v')v. 



<%fl{n,n']k,k') sup \{v,r^{m)v')v^ 



el ' 



(4.6) 



for all G V^. The inequality is strict unless u = and ^ = 0. Here we wrote 
^ = for the trivial representation of M and u; = refers to the — > limit of the 
principal series. The bound ()4.6|) is a manifest consequence of ()4.4|) and the unitarity of 
u : A ^ U{1). With these preparations we can show the crucial 

Proposition 4.1. (a) The operators T^^ : Li^^^M) —>■ L|(A/') are bounded for all (not 
almost all) uj > , C, & M . Their norms ||Tt^g|| are continuous functions of uj and obey 



- UJ^ I 



< IIT, 



00 1 



for all ^ e M and lu > . 



(4.7) 



where the inequality is strict unless uj = and ^ = 0. 

(b) Too is a transfer operator in the sense of Definition 2.1 uniquely associated with T. 

Proof, (a) For the boundedness we show that the kernel of T^^ obeys the stronger 
condition 

(4.8) 



sup sup / dn'dk' 

||t;|| = ||t)' 11 = 1 71, fc 



{v,%i:{n,n' ,k,k')v')v^ 
Clearly the expression under the first sup is bounded by 



< 00 . 



sup dgdn' T{g,n',n) sup dk'\{v^n^^^{gQ){k,k')v') 

n J k,go J 



(4.9) 
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The first factor is bounded by tlie constant Kr in To estimate tlie second factor, let 

(pi be a sequence of positive normalized functions on G approximating a delta distribution 
centered around Qq E G. From ()A.54|) 

\{v,T^^^{(t)i){k,k')v')v,\ < [ dp6{p)-%{k~'pk') snp\{v,r^{m)v')v,\. (4.10) 

J P m 

The second factor is a finite constant and it suffices to consider the dk' integral of the 
first factor. Recall from Appendix A that P = NAM, dp = d{na)dm = 5{afdndadm. 
Parameterizing k' as k' = k'{s)m', with m' G M, k'{s) G K/M (see Appendix B) one 
has 

/ dk' d{na)d'm5{a)~^(j)n{k~^namk') = I dm! I dg5{a{g))(j)n{k~^gm') <1 , (4.11) 

J K J P J M JG 

using dg = dndadmdS{s) from ()B.5|) . ()B.6|) . and the fact that 5{a{g)) < 1. This gives 
()4.8|1 . From here it follows (see Definition 2.1) that T^^ defines a bounded operator from 
L|(A/") to L|(A/"), for all 1 < p < oo. For p = 2 this is the assertion, for p 7^ 2 it gives 
an alternative (though less general) proof of the extension discussed after Eq. fl3.11|l . 

To see the continuity of the norms, recall 

||T^^|| = sup|(/,T^5/)|, feLliAf), (/,/) = l. (4.12) 
/ 

We may assume that the supremum is reached on a sequence {fi)i(^n of normalized 
functions in L|(A/'), in which case it suffices to show that lim/^oo(/h Toj^fi) is continuous 
in u). Each matrix element [fi, T^^/^) is manifestly a continuous function of uj. To show 
that this remains true for the limit Z ^ 00 we establish a uniform bound: using ()4.1|) . 
()4.4j) one has for the matrix elements 




x{fiin,k),r^{mip))fi{n',k'))v^, (4.13) 

where u enters only through the phase u^p) = z/(^(p), see ()B.8|) . The modulus of these 
matrix elements is easily seen to have the / and u independent upper bound 

sup / dpT{k' ^pk,n' ,n) 5{p)^'^ < 00 . (4-14) 

n,k,n',k' J p 

By dominated convergence one can take the / 00 limit inside the integrals, after which 
continuity in u is manifest. 



49 



Finally, to verify ()4.7|1 we return to ()4.12j) . From ()4.fj|l the modulus of the matrix 
elements can be bounded by 

|(/,T^€/)| < Jdkdndk'dn'\{f{n,k),%^{n,n';k,k')f{n',k'))v, 

< [dkdndk'dn'%flin,n';k,k')\\f{n,k)\\v^\\f{n,k')\\v^, (4.15) 



where the second inequality is strict unless u = and ^ = 0. Here both norms are 
pointwise nonnegative functions in Lq(A/'). In fact one gets a norm preserving map from 
L|(A/') to a subset of Ll{Af) by mapping f{n, k) to /o(?t-, k) := \\f{n, k)\\vi:- In particular 
/ has unit norm in L'^{M') if and only if /o has unit norm in Lg(A/'). 

On the other hand to get the norm of Tqo the supremum of (/o, Tqo/o) over all normalized 
/o G Lq(A/') has to be taken. These are complex valued functions but by the integral 
representation ()4.4|1 7oo(n, n', /c, fc') > and the supremum is reached on the subset of 
(all) nonnegative functions in Lq(A/'). Among those are the ones in the range of the map 
L|(A/') LliJ^), / 11/11 y^, described above. 

So one has for u) ^ (0, 0) 

||T^dl< sup |(/,T^J)| <sup(|/|, Tool/1) < sup (/o, Too/o) = ||Too|| • (4.16) 

(b) From part (a) we know that Too is a bounded linear integral operator with spectrum 
contained in [0, ||T||]. The integral representation ()4.4j) shows that its kernel is strictly 
positive almost everwhere. Thus Too is also positivity improving and by ()4.8|) it is a 
transfer operator in the sense of Definition 2.1. □ 

As a corollary we obtain part (b) of Theorem 1.1 announced in the introduction. 

Corollary 4.1. ^cr(T) is non-empty for at most one principal series representation - the 
limit of the spherical principal representation, a = (cu = 0,^ = 0). Further ^oo(T) can 
he isometrically identified with the ground state sector ^(Tqo) of the transfer operator 
Too- 

We add some comments on the discrete series. Recall from ()3.20p 

||T|| = ess sup ||T<,|| , (4.17) 

o-eGr 

and that a discrete series UIR is labeled by a tuple of integers ±s G N, ^ G Mg C M. 

Remark 4.1. We expect that a preferred class of discrete series representations exists 
such that a bound similar to d^. 7| ) holds. If there are discrete series UIR for which 
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||T-|-s^|| = ||T||, a natural conjecture is that they have the minimal possible M weight for 
a given s E N, i.e. = := (|s|, . . . , \s\). This requires that the norms ||T-|-s^|| of the 
operators T±s^ obey 

\\T±s^\\ < \\T±s,d forall^eM,, (4.18) 
where the inequality is strict unless .^ = ^s:=(|s|,...,|s|). 

A verification would require a concrete model for the discrete series (like that of the 
principal series described in Appendix A. 8) producing a counterpart of Eq. ()4.4|1 . We 
leave this for a future investigation. Here we proceed by identifying simple conditions 
under which discrete series representations are ruled out as candidates for the represen- 
tation carried by ^^-(T). A set of such conditions has already been identified in corollary 
3.1. We proceed by studying the role of positivity. 



4.2 The role of strict positivity 

One property which one expects from a ground state is "not to have nodes" . This means 
the ground state wave function can be chosen strictly positive a.e. In this section we 
show that, somewhat surprisingly, the positivity requirement uniquely determines the 
representation carried by a-equivariant eigenfunctions. 

As before we denote by ttoo the limiting representation of the spherical principal series 
t^ujo, uj > 0, of G = SOo(l,A^), and by Aqo the corresponding fiber operator in the 
decomposition of A (see Section 3). Further we set 

V = {ne L^'^iMr) or n G M-^L°^''^{Mr) \ fi(^, n) > a.e.} , (4.19) 

for the settings in Sections 3.3 or 3.4, respectively. 

Proposition 4.2. £^a,(t(A) Ci V = {0} unless tTo- = ttoo- Further the intersection is 
isometric to £^||a||(Aoo) and is spanned by a.e. strictly positive functions. 

Proof. Recall from Section 3 that the generalized eigenspaces £^a,o-(A) invariant under 
TTo- are generated by 'factorized' functions of the form '^fio-(Xi)(5'? '^)- Here 

rva{x){9,n) = {x{n),7T^{g)v)^ = ^x{n)lsiT^a{9)v)Ks , (4.20) 

us 

with f G £o- and x ^ ^a(Ao-) a generalized eigenfunction of A^-. By assumption at 
least one such function is strictly positive a.e. on Air, for which we write Q{g,n) = 
X]j(Xj(^); 7ro-((y')f j)o-. Replacing g with kg, k E K, and averaging over K must still 
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produce an a.e. strictly positive function. On the other hand, evaluated in the K adapted 
basis the average reads 

/ dk n{kg, n) = y2 X^{n)ooPo^Mv^ > • (4.21) 
Jk . 

Importantly the K average cannot vanish, so at least one of the projections Po7rcr{g)vi 
must be nonzero. This means must contain a /^-invariant vector, namely PoTT(j{g)vi 
for some z, and tTo- is by definition of if-type 1. But for the UIR of SOo(l, N) this is the 
case only for 7r^,g=o, see Appendix B. Discrete series representations and non-spherical 
principal series representations are ruled out. Thus, for £x,a{-^) H P to be non-empty 
the corresponding UIR must be a member of the spherical principal series, = vr^^o, 
for some > 0. 

It remains to show that only the — limit can occur. To this end we replace g 
in 1)4.211) by gk and average over K. Using the fact that vr^,o ((7)00,00 evaluates to the 
Legendre function -E'a;,oo('?o), 1 = Q^^Q^ = (^o,^, in (jB.23|l one gets the condition 

/ dkdk' n{kgk\n) = y^XiinYMooE^MQo) > 0, (4.22) 

J KxK ■ 

for almost all n G and go > 1- However, E^^qo is an oscillating function of its argument 
unless uj = 0. This means ()4.22|) cannot be satisfied for u ^ 0. □ 

We remark that the first part of the argument extends to all Lie groups of the type 
considered: £^a,o-(A) H V = {0} unless tTo- is of i^-type 1. The second part of the 
argument shows that tTo- must have a if-spherical function p{g) = vrcr(5')oo,oo which is 
real and positive on all of G, i.e. on K\G/K. An interesting (apparently open) question 
is which nonamenable Lie groups have a UIR with a pointwise positive i^-spherical 
function (not just one of positive type). 

As a corollary we now obtain part (a) of Theorem 1.1 as anticipated in the introduction. 

Corollary 4.2. ^o-(T) is empty for all but the principal series representations whenever 
one of the following holds: (i) ^o-(T) contains a strictly positive function, (ii) ^cr(T) 
contains a K -singlet. (Hi) Tg- is compact. 

Proof, (i) is a special case of Proposition 4.2. (ii) and (iii) follow from Corollary 3.1. □ 

Combined parts (a) and (b) of Theorem 1.1 show that under broad conditions the 
representation a carried by the equivariant fibers ^cr(T) of the ground state sector is 
uniquely determined and always the same for every invariant transfer operator, namely 
the limit of the spherical principal series. The existence of generalized ground states in 
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^oo(T) ^ ^(Too) is however not guaranteed from the outset. A simple but important 
special case where it is, is when all the fiber operators are compact. 



4.3 GaiT) for compact 

Here we present the proof of Theorem 1.2, as anticipated in the introduction. We 
reformulate the theorem in a more precise way as follows: 

Theorem 1.2.' Let T be an invariant transfer operator in the sense of Definition 2.1 
and 3.1, and assume that its kernel satisfies in addition the condition (C) in Section 3.3. 
Then all its ground state fibers but ^oo(T) ~ £^||t||(Too) are empty. Further Too 

is a transfer operator whose ground state sector Q{Tqq) = £^||t||(Too) is nonempty and is 
spanned by a unique normalizable and a.e. strictly positive function ipQ G L'^{N'^S^~^) ^ 
L'^{N') ® Cqq. Explicitly ^(T) is the linear hull of functions 



where q = gq^ = (go, (f)- 

Proof. By Theorem 1.1 we know that at most ^(Too) is nonempty. All functions in 
^(Too) are thus M-singlets and take values in C = V^=o. By Lemma 3.2 and Proposition 
4.1 Too is a Hilbert-Schmidt operator and a transfer operator in the sense of Definition 
2.1. Its eigenspace £^||t||(Too) coincides with its ground state sector ^(Too)- By the 
generalized Perron- Frobenius theorem ^3 El it follows that the ground state sector of 
Too is one-dimensional (non-empty, in particular) and is spanned by a unique a.e. strictly 
positive function ipo{n,k) > on Af x K, with ilJo{kon,k) = ipo{n,kko), namely the 
ground state of Too- Note that via the realization ()4.1|) the result is applied to scalar 
valued functions on A/ x K rather than to £oo-valued functions on A/". Since C, = the 
function also obeys tlJo{n,mk) = ipo{n, k), for all m e M, and thus can be viewed as a 
function on A^x S"^"^, with S^~^ = M\K. This is related to the fact that the A'-content 
of the principal series representations Tr^^^^ with = equals ^"^=0 = {(0, . . . , 0, £) , £ > 
0}. These are the SO(A^) irreducible representations which can be realized on the space 
of symmetric traceless tensors, or equivalently on the harmonic symmetric polynomials 
of degree I on the sphere S^~^. In the original model, where ipo : Af ^ Cqo, we 
relabel the components 4'o{n)f,s in the A'-adapted basis such that 4'o{n)ns = V^o('^)^m,, 
where ipo{n)em are the components of ipoi^jP) in a basis of spherical harmonics Yim{p) 
on S'^^^. The matrix element TyfiQ{ipo){g,n) = {ipo{n) , 7ioo{g)vo) , then evaluates to a 
double sum over labels of the spherical harmonics. This holds for any reference vector 
V G £oo- Specifically we choose now for v the unique A'-invariant vector vq G £oo; i-e. the 
vector satisfying 7roo(A;)fo = Vq for all k E K. In the A'-adapted basis of £oo this vector 




(4.23) 
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has components {vo)ks = (fo)oo'^K=o'^s=o- The matrix element then evaluates to 

rvo,oo{i'o){9,n') = {ipo{n) , 7roo{g)vo) = '^i'o{n)emT^ooig)emM'"o)oo ■ (4.24) 

The matrix elements 'n'oo{g)£m,oo are right K invariant and reduce to functions on Q = 
G/K, with the identification q = gq\ In the case at hand these are the Legendre func- 
tions -E(^=o,fm described in ()B.24jl . Using the integral representation in ()B.24j) the sum 
can be replaced by an integral over 5^"^: Y,em V^oH£m-Eo/m('?) = / dS{p) eo,p(g)V'o('^, P), 
with ipQ{n,p) = J2em'^o{^)£myem{p)- Inserting ()B.18|) and omitting the overall constant 
(fo)oo gives the announced expression ()4.23|) . 

It remains to show that the linear hull of these functions is dense in ^(T). We proceed 
in two steps. First we show that the choice of the iiT-invariant vector vq was inessential. 
This is because on account of the irreducibility of £00 every vector v G £00 lies in the 
closure of linear combinations of the form Q7roo(5'i)fo. Thus Tvfio{g,n) with v G £00 
generic lies in the linear hull of the functions ()4.24j) . In a second step we appeal to 
Proposition 3.6, according to which linear combinations of the form ()3.43|) (but now 
with a unique XA=||T||,<T=oo,r=i = V'o) are dense in £^A=|iT|i,a={oo)(T) = ^(T). □ 

Remark 4.2. Theorem 1.2' is a generalization of the result announced in Section 3.3 
of 112]; as a special case it contains the omitted proof of (a slightly corrected variant of) 
Theorem 2 in fT^ . Explicitly: Let T be the transfer operator of the hyperbolic nonlinear 
sigma-model (see Eqs. (2. 3), (2. 4) of [12]). Then satisfies the premise of Theorem 
1.2. 

Proof. One only has to check that the condition (C) is satisfied. This follows from the 
Lemma in Section 3.3 of ^2]. CH 



5. Conclusions and outlook 



The set of ground states of a quantum mechanical many particle system - equivalently, 
a statistical mechanics system on a finite lattice - whose dynamics is invariant under 
a nonamenable unitary representation of a locally compact group has been shown here 
to have a remarkable structure: despite the invariance of the dynamics there are always 
infinitely many noninvariant and nonnormalizable ground states. This spontaneous sym- 
metry breaking cannot be prevented by tuning a coupling or temperature parameter, 
and it takes place even in one and two dimensions and even for finite systems. The 
phenomenon is also not limited to a semiclassical regime. The linear space spanned 
by these ground states carries a distinguished unitary irreducible representation of the 
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group, which for SOo(l,iV) has been identified as the hmit of the spherical principal 
series. These properties hold for a large class of transfer operators or Hamiltonians. 
Compactness of the transfer operators restricted to the group invariant fibers is a suffi- 
cient but by no means necessary condition. The same is true for the very existence of 
generalized ground states. 

As explained in Section 2.1 the well-known theory of generalized eigenfunctions due to 
Gel'fand [1'^ and their application to group representations due to Maurin [34j is not 
sufficient to assure the existence of generalized ground states (neither as functions nor as 
distributions). However, we can guarantee their existence as functions in various situa- 
tions considerably broader than the above one. These involve by neccessity a subsidiary 
condition on the transfer operator. One can take [HH] (si) Too is a compact operator. 
(s2) the integral kernel of T has an extremizing configuration m* G in the sense that 
T{m,m';t) < Tijn^^^m^^t) for all m,m' G Ai, and possibly others. In these cases one 
has the following construction principle: 

Theorem 5.1. Let T be as in Theorem 1.1 and such that the subsidiary condition (si) 
or (s2) is satisfied. Set Vtt{v) := T*v/{v,T^v) for v G L'^{M) and t G N. Then there 
exist (explicitly known) vectors v^. G L'^{M.) and a sequence of integers {tj)j(z^ such that 



exists and is an element of 

The point of Theorem 5.1 is that even a weak limit has the tendency to either diverge 
or to vanish. It is only by a carefully tuned 'renormalization' that a finite and nonzero 
limit can be obtained which is a generalized ground state of T. The choice of the 
sequence tj is presumably inessential, but the choice of specific vectors G L'^{M.) is 
crucial. Typically these 'seed' vectors form a set of measure zero in LF'{M.) and their 
identification is a major part of the Theorem. 

The results for these 'finite' systems can be generalized in a number of ways. The choice 
of as a product manifold M. = Q^^ is natural from the viewpoint of a quantum 
mechanical or statistical mechanics interpretation. One could also replace M. with the 
phase space of a dynamical system with constraints generating the Lie algebra of a 
nonamenable group, in which case M. could be any proper riemannian G manifold 
(in the sense of (SSj)- We expect that the results of sections 2 and 3 remain valid 
in this more general setting. The main reason for specializing to G = SOo(l,iV) in 
Section 4 was that these groups have split rank 1, so their restricted dual is relatively 
simple. Nevertheless we expect that counterparts of Theorem 1.1 exists for basically 
every noncompact semi-simple Lie group with a finite center: only a tiny subset of 
unitary irreducible representations are potential candidates for the representation carried 
by the ground state sector of a system with a G invariant dynamics. 

Another extension is to supersymmetric multiparticle systems with nonamenable sym- 
metries (see jH] for one-particle systems). The transfer operators associated with graded 



the limit 
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homogeneous spaces are relevant for the description of disordered systems ITi| IHH] . 
They are not symmetric with respect to a positive definite scalar product, but have a 
unique ground state in a certain sense. Restricted to a bosonic subspace transfer oper- 
ators related to the ones considered here arise. This leads to the expectation that the 
lowest lying excitations of the original system would have a structure analogous to that 
of the ground state space found here. 

The analysis of the thermodynamic limit is an open problem. In the operator/Hilbert 
space formulation the thermodynamic limit can presumably at best be taken for specific 
lattices (hierarchical, Cayley trees, etc). For the hj^ercubic lattices directly relevant to 
lattice quantum field theories one needs to analyze the limit in terms of correlation func- 
tions, see jinj. Expectations are however that the structure of the ground state sector, 
if it changes, will 'fragment' even more [SHI El- In fact the existence of non-invariant 
expectation values in the thermodynamic limit is a more-or-less direct consequence of 
the non-amenability This should lead to a general no-go theorem (inverse, noncon- 
structive Coleman theorem). 

We believe that this circle of ideas will have a variety of applications, ranging from 
localization phenomena in solid state physics and quantum Kaluza-Klein theories to 
AdS duality and the ground states of quantum gravity. We hope to return to these 
applications elsewhere. 

Acknowledgments: We wish to thank M. Zirnbauer for calling our attention to the 
transfer operators on graded homogeneous spaces. E. S. would like to thank H. Sailer 
for useful discussions about abstract harmonic analysis. 
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Appendix A: Harmonic analysis on noncompact Lie groups 

In this appendix we summarize the results on the representation theory and the harmonic 
analysis of non-compact Lie groups needed in the main text. In appendix B we present 
more explicit results for S0(1, A^). 

1. Basic setting: The harmonic analysis on a noncompact Lie group is governed by 
Plancherel-type decompositions 

L2(G) = / dij{a) C,{G) ® C^iG) , pxi= I du{a) vr, ® tt^ , (A.l) 

where dv is the Plancherel measure on G which has support only on a proper subset Gr C 
G, the restricted dual of the group G. The -n^ are unitary continuous representations 
and Ca := Ca{G) is irreducible for u almost all a E Gr- In the following we present the 
precise version of (jA.ljl used in the main text and set the notation. 

We use the variant of (jA.lll valid for any linear connected reductive Lie group G (linear 
meaning that G is a closed subgroup of GL(A^, M) or GL(A^, C), reductive meaning that 
it is stable under conjugate transpose). Examples are S0(1,A^), SO(A^, C), SL(A^, R), 
SU(m, n), Sp(2A^, M). The Plancherel measure dv{a) is then a combination of a counting 
measure for discrete variables and a Lebesgue measure for continuous variables (see 
and references therein); for groups G having no compact Cartan subgroup the 
discrete part is absent (by a theorem of Harish- Chandra, see e.g. ISHl)- This holds in 
particular for the complex connected simple Lie groups [SHI EHj- The spaces are 
Hilbert spaces equipped with an inner product ( , )o- depending on a. As a consequence 
of the multiplicity theorems decribed below one can identify each with a subspace 
of L'^{K), where is a maximal compact subgroup of G. The tTo- are distributions over 
a space of test functions T> on G which take values in the trace class operators on 
For the class of Lie groups considered the distributions arise by integration with respect 
to a L°°{G) function n^j^g). Thus, for each (p E V the integral 7ro-(0) := Jdg(l){g)'7if^{g) 
(where dg is Haar measure on G) is a trace class operator whose matrix elements in 
some orthonormal basis Cj in C^j we denote by / dg(f){g)7!'^{g)ij. A typical choice for V 
is C^{G), the smooth compactly supported functions on G. For ip G L'^{G) fl L^{G) 
the operator iiaiSj) is Hilbert-Schmidt, for ip G L^{G) it is still compact [IHIIISI- The 
C- valued functions g i— > 7ia{g)ij are called the coefficients of 71^. They are continuous 
functions but in general do not have sufficient decay to be (square) integrable on G. This 
weak continuity is equivalent (jl^l, p. 68) to the continuity of the £o-- valued functions. 

The Plancherel theorem states that G P can be expanded in terms of eigenfunctions 
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as 

m = 
= 

The Plancherel-Parseval identity 

f dg <P{grij{g) = j du{a) ^ ^(a),, , (A.3) 

J G J Gr 2J 

expresses the unitarity of the map (j) ^ </'(o"). 

The irreducible representations on which the Plancherel measure has support turn out 
to come in famihes parameterized by conjugacy classes of Cartan subgroups of G. The 
Cartan subgroups are of the form H = T x R, where T is compact and i? ~ M*^ for 
some d. Its dual H has discrete parameters coming from T and continuous parameters 
coming from R. The labels a should be thought of as elements of H and the Plancherel 
measure takes the form 

/ du{a) = J2 fd(7i^iH:a), (A.4) 

where the sum extends over the (finite number of) conjugacy classes of Cartan subgroups 
of G and the functions viH : a) are known (|2S] and references therein). A Cartan 
subgroup here is defined as a maximal abelian subalgebra all of whose elements are 
diagonalizable as matrices over the complex numbers. The representations a & Gr 
associated with a compact Cartan subgroup are called discrete series representations, 
all others are called (on the basis of a theorem) cuspidial principal series. Among 
them are the principal series proper associated with a unique conjugacy class to be 
described below. For example SL(2,M) has two conjugacy classes of Cartan subgroups, 
H = S0(2) and H = {diag{a,a-^) \ a e M\{0}}. In contrast, SL(n,R) with n > 2 has 
[n/2] + 1 conjugacy classes of Cartan subgroups, none of which is compact. The case 
G = SOo(l, A^) will be discussed in more detail in Appendix B. 

2. Cartan subgroups: The structure of the Cartan subgroups H entering ()A.4|) is best 
described in terms of their Lie algebra f). For the Lie groups considered there exists an 
involution l such that the set of its fixed points generates a maximal compact subgroup 
K of G. (More precisely (GJo C K C G,, where G^ is the fixed point set and (GJo is its 
identity component). The involution t of G induces a decomposition of the Lie algebra 
Q = i(Bc{, where 6 and q are even and odd under (the differential of) l, respectively. The 
Lie algebras () can be assumed to be invariant under l. They are of the form f) = + cio, 
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dg<i){,g)T^a{,g ^\ 



(A.2) 
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where to C 6, Oq C a. Here a is the Lie algebra of the subgroup A in the Iwasawa 
decomposition G = NAK. To to, ao one can associate a subgroup Pq = NqAqMo of G 
called a "cuspidial parabolic subgroup". Here Nq is a nilpotent subgroup of A^, Aq is 
a subgroup of A, and Mq is such that AoMq is the centralizer of Aq in G. There is a 
systematic technique, called parabolic induction, which allows one to construct unitary 
representations of G from those of Pq. Almost all of them are irreducible and provide the 
above "cuspidial principal series" representations. For our purposes the most important 
one is the principal series proper, which is associated with the (up to conjugacy) unique 
Cartan subgroup H for which f) fl q = a, i.e. for which Ao is all of A. The associated 
subgroup P = NAM is called minimal parabolic and the construction of the associated 
principal series representations will be detailed later. 

The other extreme case is when Ao = {e} consists of the identity only, in which case 
Pq is all of G. The associated representations are precisely the above discrete series 
representations. By a theorem of Harish-Chandra G has discrete series representations 
if and only it has a compact Cartan subgroup. Equivalently ([SSj, p. 282) 

ranki^ = rankM + dim A , (A. 5) 

where ranki^ is the dimension of the maximal torus of K. For example all SOo{p,q) 
groups with pq even have discrete series, as do Sp(n, M), SU(p, q), and SL(2, R). Groups 
which do not have discrete series are SL(n, M), n > 2, and SOo(p, q) with pq odd. Several 
constructions of (all) discrete series representations are known, see |46J. In particular 
there is an elegant construction based on the kernel of the Dirac operator on homoge- 
neous spinor bundles, see IHIII]. 

The content of the theorem mentioned after ()A.4|) is that the restricted dual Gr is 
exhausted by the above cuspidial principal series representations and the discrete series 
represent at ions . 

3. Tensor product conventions: Let ?i be a separable Hilbert space with inner product 
( , ), linear in the right and anti-linear in the left argument. The conjugate Hilbert 
space H is the Hilbert space with underlying additive group identical to that of H but 
with scalar multiplication defined by (A, v) X*v, for X E C, v E H, and inner product 
{v,w) := {w,v). The Hilbert space Ti. can canonically be identified with the space 
of linear forms C(H,C) on H. Indeed by Riesz theorem C(H,C) 3 (v,-) v E H 
is a linear isomorphism of complex vector spaces. The map Ti. ^ Ti. is anti-linear; 
it associates to each v E H a. linear form as usual, i) = (v,-), v{u) = {v,u). The 
orthonormality relations of a basis Cj, i E'N, then amount to ej(ej) = 6ij. If Vi = ei{v) are 
the components of a vector v = ViCi, then the associated linear form i) has the complex 
conjugate components, v = v*ei. Suppose that H carries in addition a representation 
71 of some Lie group G. Then 7i{g)v has components {7i{g)v)i = '^{g)ijVj, where 
7^{g)ij '■= ei{TT{g)ej) are the matrix elements of T^ig). Note that in these conventions 
7^{g) acts by 'matrix multiplication' on the components Vj = ej{v). We define the 
conjugate representation tt on 7i by {fr{g)v){u) := v{7i{g~^)u)). Since {{n{g)vy ,u) = 
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{n{g)v){u) = v{7i{g^^)u) = {v,7!'{g^^)u) = {n{g)v,u), this amounts to [iT{g)vY = T!'{g)v, 
or fr{g)v = [7i{g)v]'^ . In particular fr{g)v has components {fr{g)v)i = J2j'^i9)ij'^j' if "^i 
are the components of v ETi. 

For separable Hilbert spaces Tii and 7^2 with orthonormal bases Cj, i G N, and fj, j G N, 
repectively, we define the tensor product H2 (S> Hi as the Hilbert space spanned by 
fi Cj =: fi®ei and completed with respect to the inner product {fi<S)ej, fk^ei)2 = Sik6ji. 
The tensor product 0.2 can be canonically identified with the space j2{Ti-i-i'H2) of 
Hilbert-Schmidt operators F : Hi 7^2, equipped with the inner product {F,F')2 = 
Tr[F''"F'] = ^ji^ji^ where F = fi^ij^j ^^e components of F. The isometry 
1^.2® Hi J2iHi,l-i2) is simply given by the extension of i^^Vifi) ® "^i^i)^ ^ 
'^ij '^i'^jfi (This isometry was in fact already used before in the identification /j = 
fi ® ei.) 

Suppose now that Hi, H2 carry unitary representations tti, 712, respectively. Then H2 <8) 
Hi carries a unitary representation 7r2 x tti of G x G, the outer tensor product of 7^2 and 
TTi. It is given by {7T2 x 7ti)(g2, gi){v2 (8> vi) ■= 'n'2{g2)v2 ® T<'i{gi)vi. In the realization as 
Hilbert-Schmidt operators this means 

(vr2 X ni){g2,gi)F = 712(^2)^^7^1(^1)^ = 7r2(^2)i^vri(^i)-^ . (A.6) 

The outer tensor product of two unitary representations is irreducible if and only if both 
constituents are. The diagonal representation {112 ® T^i){g) '■= {7^2 x T^i){g,g) of G is 
called the inner tensor product of 112 and tti; of course it is in general not irreducible if 
712 and TTi are. 

4- Relation to amenability: The support of the Plancherel measure in ()A.1|) also refiects 
the amenability or nonamenability of the underlying group (see 02] for the definition 
of amenable topological groups). For a continuous unitary representation vr of a locally 
compact group G the support of vr is the set cr G G weakly contained in vr. Here vti is 
said to be weakly contained in 112 if every function of positive type can be approximated, 
uniformly on compact subsets of G, by finite sums of functions of positive type associated 
with 772. Here functions of positive type can be identified with the diagonal matrix 
elements g 1-^ {v,iT{g)v) of a representation. By definition Gr, the reduced dual of G, is 
the support of the (left or right) regular representation of G; see jH], Definitions 18.1.7 
and 18.3.1. An amenable locally compact group G is characterized by the property 
that Gr = G (jS], Prop. 18.3.6). In fact, whenever G,. weakly contains a single finite 
dimensional continuous unitary representation Gr = G follows ([H], Prop. 18.3.6 and 
Addendum 18.9.5). For the group itself one has: a connected semisimple Lie group with 
a finite center is amenable if and only if it is compact (see or jHOl, Prop. 4.1.8). All the 
noncompact (linear reductive) Lie groups considered here are therefore nonamenable. It 
follows that Gr is a proper subset of G and that Gr cannot contain any finite dimensional 
continuous unitary representation. In contrast the Euclidean group ISO(A^) considered 
in Appendix C is amenable. 
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Sometimes also the concept of an amenable representation is useful, which relates to 
()A.6|) . Specifically one is interested in situations where tti ® tt2 contains the unit rep- 
resentation of G, i.e. the singlet. A simple case is when vr is finite dimensional; then 
TT ® 7t always contains the unit representation (as F = I by ()A.6jl is clearly an invariant 
tensor). More generally one has Prop. A. 1.11 and Corollary A. 1.12): Let tti, 112 be 
unitary representations of the Lie group G on Tii, 7^2- Then the following are equiva- 
lent: (i) TTi ® 7!'2 contains the unit representation, (ii) there exists a finite dimensional 
representation tt which is a subrepresentation of both tti and n2. Further, if tti is irre- 
ducible condition (ii) can be replaced by: (ii)' tti is finite dimensional and is contained 
in TT2. The unitary representation vr is called amenable if for tti = vr, 7r2 = vf any one of 
the conditions (i)-(iii) is satisfied. This in turn can be shown to be equivalent to |1]: a 
unitary representation vr of a Lie group G on a Hilbert space Ti is amenable if there exists 
a positive linear functional u over BiH) (the C*-algebra of bounded linear operators on 
Ti.) such that u {it {g)Tn{g)~^) = uj(T), for all g & G and all T G B(TC). Further a locally 
compact group is amenable iff every vr G G is amenable For a simple noncompact 
Lie group (connected with finite center and rank > 1) the only amenable representations 
are those containing the trivial one. 

5. Characters: The coefficient functions g 1— > 'Kfj{g)ij form a unitary irreducible repre- 
sentation, viz 

k 

T^aie)ij = Sij , T^aig'^)ij = [^aig) ji]* ■ (A. 7) 

For a compact Lie group the coefficients also obey orthogonality and completeness rela- 
tions essentially summarizing the content of the Plancherel (or Peter- Weyl) expansion. 
In the case of a noncompact Lie group these have no direct counterpart in that dou- 
ble sums over products of the matrix coefficients or traces diverge. Instead character 
functions and the associated spectral projectors provide the appropriate substitute for 
orthogonality and completeness relations. 

Characters are defined as follows jSH]- Since 0(cr) is a trace class operator for all (j) G V 
the trace 

0.(0) := J2 ^i^h = E / m^Ag^% , (A.8) 

is well-defined and independent of the choice of orthonormal basis on Thus ©^r : V 
C is a distribution over T> for every unitary irreducible representation tt„. It characterizes 
such a representation in that 0^^ = ©0-2 holds if and only if the representations tt„^ and 
TTcra are unitarily equivalent. A representation tTo- is called tempered if the distribution 
0. extends continously to S{G), the Schwartz space of functions G C°°{G) such that 
and all its derivatives are square integrable on G. The sum in ()A.8|) can of course not 
be pulled inside the integral: as all eigenvalues of Haig) have modulus one the sum over 
T^a{.g)ii diverges. However for the class of Lie groups considered a regularity theorem 
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ensures the existence of a locally integrable function G^r such that 

0.(0) = / dgct>{g)Q„{g-^) for all G I) . (A.9) 

JG 

The function 60- is constant on conjugacy classes in the sense that Qa{gg'g~^) = ^a{,g') 
for all 5^ G G and g' G G' . Here G' is a dense open subset of G characterized by the 
fact that each of its elements lies in precisely one Cartan subgroup H of G, see e.g. 
The character function is also an eigenfunction of Z(G), the abelian algebra of all 
bi-invariant differential operators on G. In terms of them the Plancherel expansion ()A.2|) 
can be rewritten as 

^{g)= [du{a){Q,*^){g), G D . (A.IO) 

Here 

(0. * <P){g) := f dg'e^{gg'-')<P{g') = ^ /" dg' <P{g')J2MghM9'~% ■ (A.H) 
Jg j Jg j 

Due to the properties of 6. the above tempered irreducible representations come in 
families parameterized by conjugacy classes of Cartan subgroups of G. 

The bi-invariant function {g,g') ^ Qa{gg'^^) in ()A.11|) can be viewed gularized' 
version of the formal double sum that would arise by pulling the sum over i inside the 
integral. There are two natural ways to achieve such a regularization. 

One is by performing averages over Borel sets in G^, which gives rise to spectral projec- 
tors: 

Ei{gg''') := jdu{a) Q^igg'-') , (A.12a) 
J dgErigig-')Ej{gg^') = EjnAgig^') , (A.12b) 

EeSgg'') = !dv{a) QAgg''') = ^g.g') ■ (A.i2c) 

Gr 

6. K-finite functions: A literal way to take the sum over i in ()A.11|) inside the integral is 
by restricting the class of functions to the i^-finite ones. A function / G C^(G) is called 
left (resp. right) K-finite ([57J p.236) if the set {f{kg),k G K} (resp. {f {gk),k G K}) 
lies in a finite dimensional subspace of C{G), the continuous functions on G. It is called 
(bi)-K-finite if both holds. Let K 3 k rf^{k), k E K, he the unitary irreducible 
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representation of K with hightest weight k on a vector space 14, '■= dimVK. Their 
characters k i— > Xnik) := Tr[rK(/i;)] obey Xk*Xk' = SK,K'd^^XK (where we took k to label a 
unitary equivalence class and * denotes the convolution product with respect to K). For 
any finite subset I C K then Ej := X^ks/'^kXk is the spectral projector; in particular 
Ei*Ej = EiDj- The Fourier expansion takes the form / = J2k£K dK.f*Xn and converges 
in the L'^{K) norm. One can view the characters as functions on G with support on 
K only and convolute functions in C^{G) with the projectors Ej (with the convention 
(/ * h)(g) = }dg'f(gg'-^)h(g') = }dg'f(g'-')h(g'g)). Then (H, p.237) 

/ e Cr(G) ,s I 'If'^l'L : i • (A.13) 



right ir-finite iff f * Ej = f . 

for some finite I C K. The function / is bi-.ft'-finite ii Ej * f * Ej = f holds. 

A representation vr of G on a Hilbert space Ti is called ii'-finite (jSZI, p. 232) if its 
restriction to the compact subgroup K is unitary and decomposes into a unitary sum 
of irreducibles (r^jK;), k & K, each occuring with finite multiplicity m^. That is, 
H = rn^VK as a representation of K. Let : Ti. t^kVk. be the orthogonal 

projection. Note that an alternative characterization of a i^'-finite representation vr is 
that is an operator of finite rank on Ti for all k & K. A vector v e H is called i^'-finite 
if 7T{k)v, k & K, generates a finite dimensional subspace of TC p. 25). Evidently 

this is the case iff Pjv = v for some finite I G K. To study the relation between in- 
finite functions and i^-finite vectors the following explicit realization of the projectors 
is useful: 

P^v = d, [ dkx.{k-')nik)v , ven. (A.14) 
Jk 

Consistency requires that 7r(/i;) oP^ = P^ o7r(A;), k & K, which indeed is a property of the 
right hand side of ()A.14|) using that the character Xk is constant on K conjugacy classes. 
To verify ()A.14|1 first note that the matrix elements of n{k), k G K, are blockdiagonal 
in the basis {e«;,s, s = 0, . . .,mf,d,,-l, k G K}, where 6^,^+^^ = e^^rn, m = 0, . . .,d,,-l, 
is an orthonormal basis of V^. Explicitly 

(e^'s', T^{k)e^s) = S^',K r^{k)s's ■ (A.15) 

Any V E H can by assumption be expanded as v = J2k si^'^s,v) g^s and 7i{k) acts on 
m^K; as the blockdiagonal matrix r^lk). Thus, to verify ()A.14|1 one only has to show 
that {e^'m', Pkv) = 5i^',K{.^Km'^ v). Taking the trace over mi = m2 in 



dkVf^iJt )mim,2 ^ K,' {k) imi,m4 , ^KK'^m,im4^m2m3 , (A.16) 



(see e.g. 0, p. 170) this readily follows. 
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The interest of these constructions hes in fact that any K-finite representation is a 
direct orthogonal sum of unitary irreducible representations (|SZ1; Lemma 8.6.22). The 
irreducible representions are of course also K finite and for them explicit bounds on the 
multiplicities are available. For the purposes here two results are relevant: Let G be a 
semi-simple linear connected real Lie group and K a maximal compact subgroup. Then 
tTct is i^'-finite for any a G G and the irreducible representation k, E K occurs in tTctIk at 
most with multiplicity d^^ (see 0, p. 331). A theorem by Harish-Chandra ([58j, p. 319) 
states that essentially the same is true for any connected semi-simple Lie group with 
finite center (with a technically slightly different notion of irreducibility) . On account of 
these multiplicity bounds one can identify as a vector space with 0^ rn^Vf^ and since 
the multiplicities < d^, do not exceed those in the decomposition of L'^{K) (which 
equal d^) one can identify each C^- with a subspace of L'^{K). In certain cases the upper 
bound on the multiplicities is even sharper. In the case G = SOo(l, A^), K = SO(A^) we 
focus on, each k, E K can occur at most once in iTalK, by a result due to Dixmier ^Uj. 
Another case when this happens is for G = SL(2,C) and K = SU(2), see [SB], p. 317, 
where also the general conditions for < 1 are discussed. 

Let now vr be a i^-finite representation and write n{ip) = J dgip{g)T^{g) for ip G C^{G). 
Using Eq. ()A.14|1 one readily verifies the following relations 

ti{E,*^) = t^{'4j)P, n{ij * E,) = P,n{^) , (A.17) 

and similarly for the two-sided projections. The same holds for the Fourier coeffi- 
cients fdg4'{g)7i{g~^) = (vr * V')(e). For an irreducible representation tTo-, a E G, and 
ip G L}{G) n L'^{G), the relations ()A.17|) then imply the following decomposition of the 
Hilbert-Schmidt operator ^J^a) : Lf, ^ L^: 

^ ^ ^K2S2 '^('^)k2S2,K1S1 ^KlSl 
K2,S2,K,IS1 

= J2 P-2^i^)P-. = E {E,.*^*E.2r{(^) ■ (A.18) 

For left i^-finite functions the sum over Ki is finite, for right if-finite functions the one 
over K2 is, and for bi-i^ finite functions both sums are finite. Here e^s is the basis 
dual to e^s, s = 0, . . . , dim K - 1- In particular 'ip{cr)i^^s2,^isi = e^^s2{i^{(^)eKisi) = 

ifiK2S21 '4'{'^)^KlSl)(J- 

7. Harmonic analysis on G/K: If instead of Fourier analyzing functions in L'^{G) one 
is only interested in L'^{G/K) functions, where Q ~ G/K is a symmetric space of 
noncompact type, the harmonic analysis simplifies considerably. In group theoretical 
terms it amounts to the decomposition of the quasiregular representation ii of G on 
L'^{Q). We resume the specifications and notations of Section A.l; in particular i^' is a 
maximal compact subgroup of G, so that Q is an indecomposable Riemannian symmetric 
space. The key simplification is that for the harmonic analysis on G/K only a subset 
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of the principal series representations proper is needed (see [SB] and j21|, Section IV. 7). 
Recall that the principal series representations proper are those induced by the minimal 
parabolic subgroup P = NAM, where G = NAK is the Iwasawa decomposition of G 
and M is the centralizer of A in K. The inducing construction will be described below. 
The upshot is that the principal series representations tt^^^ are labeled by a character 
V : A ^ U{1) of A and by a unitary (finite dimensional) irreducible representation 
G M of M. The principal series representations associated with the singlet ^ = of M 
are called the spherical principal series representations (or minimal or class 1 principal 
series; see e.g. |SH1, Vol.1, p. 462). These representations Tr^^o are thus labeled by elements 
of A only, which can be identified with a subset of R'^™^. We write Q for this subset 
and label the characters v = and the representations vr^^o := tt^^.o by points in u; G Q. 
The abstract definition of G/K as the subset of G^ needed for the harmonic analysis 
on G/K thus turns into the bijection G/K c::^ Q G M*^™"^. Moreover the Plancherel 
measure du^a)]^^ restricted to the spherical principal series is absolutely continuous 

with respect to the Lebesgue measure duj on 



pdim A 



du{a)^ = -^^. (A.19) 

G/K |c(u;)P 

Here c{u)) is the Harish-Chandra c-function, for which an explicit formula in terms of 
the structure of G/K is known. Concerning the K content of the tTi^.o representations, 
it is known that all of them contain the i^'-singlet with multiplicity 1 ([23^, p. 414). As 
a consequence the representations vr^^o can be set into one-to-one correspondence to K- 
spherical functions. A continuous function p on G is called i^"-spherical (j2l], p. 357) if 
it satisfies 

Jdkpig,kg2)=pigM92). (A.20) 
This implies that p is i^'-bi-invariant and normalized p{e) = 1. 

One can explicate this structure by writing out the coefficients of Tr^^^o in the /^-adapted 
basis of Section 2.4 using ()A.15jl . An equivalent characterization of the matrix elements 
in ()A.15|) is then 

rt,{k2)s2s' ■ (A.21) 



In particular one sees: 7r^,o(fi')oo,Ks left i^'-invariant, 7r^,o(fi')Ks,oo is right i^-invariant, 
and 77^,0 (fi') 00,00 is -ft'-spherical. The right K-invariant functions g ^ [7r(^,o(fi')]Ks,oo are 
sufficient for the harmonic analysis on the right coset space G/K. To see this observe 
that for a left /^-invariant function {(f){gk) = (j){g), for all k G K) the decomposition 
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()A.2jl specializes to 



Jg/k Jk 



<P{gK) 



ldu{(j) y2^^^)(>o,Ks7(a{gK)^s,oo ■ (A.22) 



Here we wrote G/K for the subset of representations in Gr for which the matrix elements 
0((t)ks,oo are nonzero. According to the above results it consists of spherical principal 

series representations only, and there is a bijection G/K ~ Q C M'^™^ to a subset of 
j^dimA Combined with ()A.19|) this allows for a very explicit description of the harmonic 
analysis on G/K. Via the Iwasawa decomposition the section gs{q) provides a one-to-one 
correspondence between points q & Q and right ii'-orbits (recall that gs{q) equals na 
viewed function of q). We define 

Eu,Ks{.q) ■■= K,o(fi's(g))]oo,K6 ■ (A.23) 
The functions E^^^s{q) are equivariant with respect to vr^^O) i-e. 

Eoj,Ksig'^q) = ^E^^^>s'iq) T^uj,oig)K's',Ks ■ (A.24) 

k's' 

The spectral synthesis formulas then assume the form 

f duj 
Jq\oH\' 

i^{uj)^, = d-iQ{q)ij{q)E^^^s{q). (A.25) 
JQ 

Finally we mention that in the fiber decomposition 

/® di ) f® di ] 

^T^^^, / (A.26) 

all fiber spaces £^ are isometric to L'^{K/M). This can be understood from the fact 
that generic (nonspherical) principal series representations can be modeled on L'^{K) 
(see below); so for the M singlets this gives model spaces isometric to L?'{K/M). 

8. Principal series: As is clear from the preceeding discussion the principal series of 
unitary irreducible representations is at the core of the harmonic analysis for noncompact 
Lie groups. For complex (noncompact semisimple connected) Lie groups (with a finite 
center) it suffices in fact for the harmonic analysis. Since we will need a number of results 
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that occur in its construction we present here a concise but in principle selfcontained 
summary thereof. For definiteness we consider again the class of linear reductive Lie 
groups, though everything goes through also for arbitary non-compact semi-simple Lie 
groups with a finite center. 

The principal series arise as special cases of so-called multiplier representations defined 
as follows. Consider a diffentiable manifold Ai carrying a differentiable G action Ai 3 
m ^ g.m & M.. For a finite dimensional vector space with inner product ( , )y let 
L^(A1, V) be the Hilbert space of functions f : M. ^ V square integrable with respect 
to 



(/i,/2) := j d-f{m){fi{m)j2im))v , 

{Mm), Mm))v := Mm): /^(m). . (A.27) 

s 

Let further G x Ai 3 (g,m) m), x(fl') m) : V V , he a cocycle satisfying 

Xi9i92, m) = xigi, m)xig2, gi-m) , x(e, m) = I . (A.28) 

Set 



H9)f]{m) ■■=x{9,m)fig.m)^l^^^, (A.29) 

where d'^g = (i(7 o g) is the translated measure and d'jg/d'y is the Radon-Nikodym 
derivative. The latter ensures both the representation property and the unitarity with 
respect to the inner product ()A.27|) 

7r(^i)7r(^2) = rr{gig2) , (7r(^i)/i, 7r(^2)/2) = (/i, /2) • (A.30) 

One now applies this construction principle to the group manifold K, where K is the 
maximal compact subgroup of G. Via the Iwasawa decomposition G = NAK = BK it 
carries a G-action induced by the right translations. Explicitly let g = n{g)a{g)k{g) = 
b{g)k{g) be the unique Iwasawa decomposition of some g E G. Then 

kog = b{kog)k{kog) , ko e K, (A.31) 

that is, the coset space B\G of left equivalence classes bg g, b & B, is isometrically 
identified with K by picking the representative kik^g) =: g[ko] in the Iwasawa decom- 
position. For each g & G the map kg g[ko] defines a diffeomorphism on K, which 
is the G-action on K needed to define the multiplier representation ()A.29|) . We write 
d{g[k]) for the translated bi-invariant Haar measure dk in K and d{g[k])/dk for the 
corresponding Radon-Nikodym derivative. According to the general construction 



H9)Mk) = xi9,k)f{g[k])\i^^, (A.32) 
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defines a unitary representation on L'^{K,V) for any cocycle xidi^) '■ V ^ V. It 
remains to compute tlie Radon- Nikodym derivative. It comes out to be A{b{kg))~^ , 
where b i— A (6) is the (right) modular function of the (non-unimodular) subgroup 
B = AN. That is, 

[ dkf{k)= [ dkfig[k])A{bikg))-\ (A.33) 
Jk Jk 

for all / G Cc{K). The proof is simple and instructive, so we present it here, also 
in order to set the conventions (see e.g. jSH], p.44f and p.83f), with the opposite 
conventions). Let db be the left invariant Haar measure on B and dg, dk the bi-invariant 
Haar measures on G, K, respectively. Then 

dg = dbdk for functions of g = bk , (A. 34) 

where the order bk (rather than kb) is important. Indeed, by definition the map B x 
K ^ G, [b, k) H-^ bk is an isomorphism. There exists therefore an analytical function 
J : B X K M"^ such that dg = J{b, k)dbdk. Since dg = d{bogko) for all bo & B, ko E K 
it follows that J{bob,kkQ) = J{b,k). Thus J must be a constant, which by a change 
of normalization can be set to unity. Note that if functions of kb were considered the 
counterpart of ()A.34|) would read dg = drbdk, with drb the right Haar measure on B. 
Our convention for the modular function is that of |15j, p.46ff] 

d{bbo) = A{bo) db , (A.35) 

so that drb = A{b~^)db. With these preparations at hand the verification of ()A.33|) 
is straightforward. Let E G Cb{B) be a function such that J^dbE{b) = 1. Given an 
arbitrary / G Cc{K) define a function F G Cc{G) hj g = bk E{b)f{k). Then 

J dkfik) = jjgFig) = jjgFiggo) = j dkdbFibkgo) , (A.36) 

for all go G G. By ()A.31|) kg^ decomposes as kg^ = b{kgo)gQ[k], so that Fipkgo) = 
E{bb{kgQ))f{gQ[k]). Inserting into ()A.36|) and shifting the integration variable b 
bbikgo)-' gives (p03|). 

To proceed we describe the action of G on itself in terms of the Iwasawa decomposition 
G = NAK. Converting the relations in [2^], P-84 into the present conventions one has 

k{gig2) = k{k{gi)g2) = g2[k{gi)] , 

a(fl'i5'2) = a{gi)a{k{gi)g2) , (A.37) 



nigm) = ri{gi)[a{gi)n{k{gi)g2)a{g 
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As a check note n{gig2)a{gig2)k{gig2) = n{gi)a{gi){nak){k{gi)g2) = gig2- In particular 
it follows that a{g, k) := a{kg) is an A-valued cocycle, 



a{gig2,k) = a{gi,k)a{g2,gi[k]) , a{e,k) = e. (A. 38) 

We evaluate it on two types of continuous group homomorphisms. The first, 6 : A —>■ IR+, 
is obtained from 

d{ana~^) =: 6{aYdn, A(an) = 5(a)^ , (A. 39) 

where g = nak is the Iwasawa decomposition. The first relation in (jA.39jl defines 6, the 
second readily follows from db = dadn for functions of b = an (see jHS], p.80, [SH], p.39). 
The second group homomorphism u : A U{1) assigns to each a G A a complex phase 
z/(a) G f/(l). 

We define a representation of G on L'^{K, V) by 

Mg)fm := 6{a{g, k))-'u{a{g, k))f{g[k]) . (A.40) 

Since it is obtained by specialization of ()A.32|1 it is unitary. The following property of 
will allow one to restrict it to subspaces of L'^{K,V) such that the resulting repre- 
sentations are equivalent to the principal series representations sought after. Namely: 

(i) The restriction of vr^ to K is the right regular representation of K, i.e. 'n'u{ko)f{k) = 
f{kko). (ii) TT^ commutes with the left regular representation of M 

i{m) o 'Ki,{g) = Tiy^g) o £(m), for all m e M . (A.41) 

Here M is the centralizer of A in K, that is the subgroup M G K whose elements 
commute with all elements of A. Property (i) follows from a{ko, k) = e and fco[/c] = kko. 
Equation ()A.40|) is equivalent to 

a{mg) = a{g) , k{mg) = mk{g) , for all m & M . (A. 42) 

To verify ()A.41|) it suffices to note that n{mg) = mn{g)irr^ since M normalizes A^. 
Thus mg = n{mg)a{mg)k{mg) = mn{g)a{'mg)m~~^ k{mg) , which gives ()A.41|) . 

Let now m i— > r^{m), ^ G M, be an irreducible representation of M on and consider 

LliK) = {/ G L\K, V^) I f{mk) = r^{m)f{k) , m G M} . (A.43) 

Eq. (IA.40D implies that for / G Lj{K) one has [TT^{g)f]{mk) = ri:{m)[7i^{g)f]{k). Thus 
TTi, : L'^{K) L'^{K) and the restriction 

7CuM-=M9)^^^^^, (A.44) 

Lj{K) 
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is well defined. The subgroup P := NAM is a (minimal) parabolic subgroup of G and 
the representations ()A.44|) are the P -principal series representations of G in the so-called 
'compact model'. Explicitly 

M9)fW = 5{a{kg))-^v{a{kg))f{g[k]) , g = nak . (A.45) 

The standard definition of the P-principal series is by 'parabolic induction'. For com- 
pleteness we briefly recap this construction and verify that it is equivalent to ()A.45|) . 
First note that in the above notation Xv,i{nam) = i'{a)r^{m) is a unitary representation 
of P = NAM on V^. Indeed, rearranging the Iwasawa components of pi,p2 G P one 
finds P1P2 = n{pi)n{m{pi)a{pi)p2)a{pi)a{p2)m{pi)m{p2), using an{g)a~^ = n{ag) and 
mn{g)m~^ = n{mg). The P-principal series is then defined as the representation of 
G induced by Xiy,(^ IndpXi^,?- This means one considers the linear space of functions 
F -.G such that 

F{pg) = /\{p)-^l\,^^{p)F{g) , 

(Pi,P2):= / dk{F,{k),F2{k))v,, (A.46) 
Jk 

which upon completion with respect to the norm given forms a Hilbert space Ti-^^^. Here 
A is the modular function of P = NAM, which (since M is compact) coincides with 
the modular function of P = NA and hence is given by A{nam) = 5(a)^. Explicitly the 
covariance equation in ()A.46jl thus reads 

F{namg) = S{a)~^u{a)r^{m) F{g) . (A.47) 

The induced representation then is defined as the restriction of the right regular repre- 
sentation to Tiv 

[Ind^(^?o)i^](^7) := F{ggo) , F G H^^^^ . (A.48) 

The unitarity follows from ()A.33|) applied to f{k) = {Fi{gQ[k]), F2{go[k]))vi:- The equiv- 
alence to the 'compact model' ()A.44jl . ()A.45j) comes about as follows. Via 

F{nak) = 6{a)-^iy{a)f{k) , (A.49) 

one can set up a correspondence between functions F G Cc{G) and / G Cc{K). Moreover 
F G T^x^j ^^'-^ only if / G Ll^{K). To see this one rewrites the argument namg in 
()A.47|) as namg = nn{amg)aa{g) mk{g)] in this form the equivariance properties are 
directly mapped onto each other. The square integrability in both function spaces is the 
same, as F\k = / in (IA.49jl . Finally the correspondence ()A.49|1 maps the representations 
onto each other: We use the relation kgo = {na){kgo)go[k] to rewrite ggo = nakgo as 

ggo = nn{akgQ)aa{kgo)go[k] . (A.50) 
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From here one easily verifies [lndp{go)F]{g) = F{ggo) = [7!-^^^{go) f]{k) , for g = nak. 
Taken togetlier, tlie restriction map F ^ F\k intertwines tlie unitary representations 
IndpXiy,^ on H^^^ and tt,,^^ on L'^{K). 

In summary, the principal series representations of a semisimple Lie group are param- 
eterised by a unitary character u : A ^ U{1), i.e. u & A, and by an element ^ G M, 
where M is the centralizer of A in K and G = NAK is the Iwasawa decomposition. 
From the viewpoint of the Plancherel measure ()A.4j) they account for the conjugacy 
classes of Cartan subgroups of the form H = T x R, where the noncompact part R 
is isomorphic to A (see App.A.1.2), while the compact part T comes from the Cartan 
subgroup Hm of M. Schematically H = A x Hm, = {^,0- The construction does 
not ensure irreducibility in itself; typically however principal series representations are 
irreducible. By Kostant's theorem (|SH], Thm. 5.5.2.3) this is the case whenever G is 
a semisimple connected Lie group with finite center and P is a minimal parabolic sub- 
group. In particular this holds for all SOo(l,A^), < 3, and for the two-fold simply 
connected covering Spin(l, A^) of SOo(l, A^), with A^ odd. In rare cases a principal series 
representation may fail to be irreducible; however it then decomposes into a direct sum 
of irreducible representations, the number of which cannot exceed the order of the Weyl 
group (see Vol.1, Corr. 5.5.2.2, p.461). 

The action of tTj,,^ on L'^{K) and its matrix elements can be described fairly explicitly. 
To this end set 7r,^(0) := Jijdg(j){g)'7iu{g), for e Cc{G). Then 

Ki(p)mo) = jdkn,mko,k)f{k), 

T[y{(j)){kQ,k) = j d{na) (j){kQ^nak){5~^v){a) , (A.51) 

that is, T^v{(t)) acts as an integral operator with the given kernel. If the function has 
support only on K the kernel reduces to 7r,^((/))(fco5 k) = (f){kQ^k). Both statements follow 
directly from ()A.45|) taking into account that g[kQ\ = k{kQg) and dg = d{na)dk for 
functions oi g = nak. 

Since T^y commutes with the left regular representation of M, see Eq. flA.40|) . the kernel 
obeys 

TTi^{(f)){mko,mk) = 7!;^{(f)){kQ, k) , m&M. (A. 52) 

Using the fact that for any m & M the map n (—> m^^nm is a diffeomorphism of A^ onto 
itself with unit Jacobian, dn = d{m^^nm) , the invariance ()A.52|1 is also readily verified 
directly. Both the trace Tr[7r,^(0)] = f^dk7iiy{(j)){k,k) and the Hilbert-Schmidt norm 
IKf (0)ll2 = Tr[7ri,(0)*7r;^(0)] are finite for G C^{G). This remains true upon restriction 
to L'^{K) where TTy^{(j)) basically gives the Fourier coefficients entering the Plancherel 
decomposition. In detail let 

[P^f]{k) := / dmr^{m-')f{mk) , [P^/](mA;) = r^{m)[P^f]{k) , (A.53) 

J M 
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be the projector from L'^{K, I4) to Ll{K). Then 7r^^(0) := 7Tu{(j))P^ = P^t^M = ^{^^ 0^ 
acts as an integral operator with matrix valued kernel 

7iu^{(j)){ko,k) = / dmTC„{(j)){ko,mk)r^{m) 
J M 

= J dp(j){kQ^pk){5~^u){p)r^{m{p)) , (A.54) 

where P = NAM, dp = d{na)dm and m{n'a'm') = m'. Note that the i{M) invariance 
()A.52|) of the kernel 7rj^(0)(fco, k) has turned into a covariance 

■Ku^{(t)){mko, mk) = r^{m) 7r„i:{(f)){ko, k) r^{m)~^ . (A.55) 

As noted before, for G C'^{G) the kernel ()A.54jl defines a trace class operator on 
Both the left and the right action of Tiu^ig) on Tr^,^{(p) produces again a trace 
class operator whose kernel is readily worked out. One finds 

kernel of 7r^^i:{g)7r^^{(j)) = 7r^^^{i{g)(j)){k, k') 

= {6~'u){a{kg))n,,^{4>){g[k],k'), (A.56a) 
kernel of iT^^i.{(f))7r^^{g) = n^^^{p{g''^)(f)){k, k') 

= {5u)-\a{k'g-'))7T,,^mk,g-'[k'])). (A.56b) 
Note that ()A.56b ) is the formal adjoint of ()A.56b ). as it should. 
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Appendix B: The restricted dual of SO(l,N) 

Here we explicate some of the general results in appendix A for the case SOo(l,A^). 
These groups have split rank 1, i.e. the subgroup A in the Iwasasa decomposition is 
one-dimensional. As a consequence the restricted dual is exhausted by the principal 
series proper and the discrete series; cuspidial principal series are absent. Further all 
unitary irreducible representations are multiplicity free, which gives rise to very explicit 
descriptions of their SO(A^) content. Finally one can get explicit expressions for the co- 
efficients of the spherical principal series in terms of simple special functions (generalized 
Legendre functions). 

1. Group decompositions and orbits: The groups SOo(l,A^) are generalizations of the 
Lorentz group {N — 3) and the de-Sitter group (A^ = 4). They are connected and locally 

compact; the two-fold simply connected covering group of SOo(l, A^) is Spin(l, A^). The 
natural action of SOo(l, A^) on R-*^'^ decomposes it into 6 types of orbits: the origin {x = 
0}, the two-sheeted hyperboloids {x ■ x = r, ±x'^ > 0}, the one-shceted hyperboloids 
(de-Sitter spaces) {x ■ x — —r} (with r > in both cases), and finaUy the cones {x ■ x — 
0, ±x° > 0}. 

Both for the detailed description of these orbits and for the representation theory the 
Iwasawa decomposition G = NAK is instrumental. For G — SOo(l,A^) it takes the 
following form: K ~ SO(A^) is the isotropy group of = (1,0, .. . ,0). A is the one- 
dimensional subgroup generated by a{6), 6 eW, and A^ is the A^— 1 dimensional subgroup 
generated by n{t), t = {ti, . . . , tN-i)'^ G M^^"*^, where 





/ ch^ sh^ 


\ 




fl + lt^ 


t^ \ 




a{e) = 


sh^ ch^ 




n{t) = 
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■ (B.l) 
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witht^ -=11 + . . .+t%^^. Observe that n(t)n(t') =n{t + t') and 0(6*) a (6^') = a{e + e'), so 
that A^ ~ M^~^ and A ~ M. Each element g & G admits a unique decomposition g = nak 
with n E N, a E A, and k E K. Since g~^ — k~^a~^rr^ the same holds for a decompo- 
sition with the subgroups oppositely ordered, G — KAN . Let 77 = diag(l, —1, . . . , —1) 
be the bilinear form on M}'^ . 

As before let M denote the ccntralizer of A in K. Clearly M ~ SO(A^-l), with S0(A"-1) 
acting on the lower (A^ — 1) x (A^ — 1) block of the matrices. One has 

a{e)n{t)a{e)-^ = n{eH) , mn(t)m-^ = n{mt) , m E M . (B.2) 

This shows that as subgroups AN = NA and that NM is the semidirect product of 
A^ ~ R^-i with M. 
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Explicit parameterizations of the various G-orbits in M^'^ can be obtained from the 
Iwasawa decomposition by letting it act on a reference vector of the orbit. For the upper 
sheet Hat = {q - q = 1 , go > 0} of the two-sheeted hyperboloid we take g^ = (1, 0, . . . , 0) 
as the reference vector. The action of G via the NAK decomposition then gives the 
'horispherical' coordinates on Hat. Indeed, n{t)a{6)q^ parameterizes a unique point 
g = (go, ...,qN) in Hat, 

qo = ch9 + h^e-\ qi = sh9 + h^e-\ g^ = e'Vi, i = 2,...,N, (B.3) 

and {6,ti, . . . , tAr_i) are its horospherical coordinates. One can invert the transformation, 
in which case the product n{t)a{6) viewed as a function of g gives back the section 
Qsiq) of Eq. ()2.13|) . The isometry Hjv — S0(1, A^)/SO(A^) is likewise manifest. Similar 
descriptions - not needed here - exist for the cone {x-x = 0, x° > 0} and the one-sheeted 
hyperboloid {g ■ g = — !}• 

Finally we note the relevant invariant measures. Let dk denote the normalized Haar 
measure on = SO(A^). Set da = dO for a = a{6) G A which gives Haar measure on A. 
Then 

d{na) = e~^^^-^^de dti . . . dt^-i , (B.4) 

is the left invariant measure on NA. The left invariance d{n{to)a{6o)na) = d{na) is 
easily checked from a{9o)n{t) = n(e^°t)a(^o)- The Haar measure on G in the NAK 
Iwasawa decomposition is then given by 

dg = d{na)dk , g G NAK . (B.5) 

If elements k E K are decomposed according to k = k{s)m, m G M, s G S^^^ ~ K/M^ 
the normalized measures on K, M and S^~^ are related by 

dk = dS{s)dm. (B.6) 

2. Dual and restricted dual of SOo{l, N) : For G = SOo(l,A^) and Spin(l,A^) the dual 
space (as a topological space) is known completely j2]. The lists in jlOj and [26^ are not 
quite complete and do not discuss the square integrability of the representations. 

To illustrate the relation to the restricted dual Gr we briefly sketch these results here. 
All unitary irreducible representations (UIR) come from those of the Lie algebra. For 
general N the relevant UIR of the Lie algebra so(l, A^) have been classified by Ottoson 
jlO] and Schwarz |17j. Apart from the singlet ttq there are three main types of UIR. 
For the harmonic analysis on L^(SOo(l, A^)) only two of them are needed, the principal 
7r(princ) and the discrete series 7r(disc). In addition there are complementary series 
7r(comp) (subdivided in [101 E! into supplementary series and exceptional series). Each 
UIR is labeled by r := rank SOo(l, A^) = [(A^ + l)/2] real parameters, (^i, . . . , ^^-i, s). 
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The are nonnegative and are either all integers or all halfintegers and are ordered 
^1 < ^2 < • • • < ^r-i- The remaining parameter s can be real or complex. Depending 
on the value of s the parameters ^ are constrained by further conditions, which together 
with the value of s specify to which series a given UIR belongs. For the principal series 
one has 

7r(princ) : s = icu , to > , ^GSO(iV-l), (B.7) 

where the explicit description of the weights ^ is given in Eq. (jB.lljl below. The general 
discussion of the principal series from Appendix A can be straightforwardly specialized 
to the case of SOo(l, A^). The A homomorphisms u =: u^^ and 6 are given by 

ly^ : f/(l) , uMe)) = e'^' , > , 

5 : A^R+, S{a{9)) = e-^^ . (B.8) 

For N = 2r even there are also discrete series representations which enter the Plancherel 
decomposition. One has [211 

7r^(disc) : ±s < < . . . < , ±s G N, G N , (B.9) 

where N are the positive integers and the vr^ series are labeled by the sign of s. The 
(— s,^) representation is the mirror image of the (s,^) representation in the following 
sense. Define a spatial reflection by 9{qo, qi, . . . , q^) = (go, —qi, • • • , qN), which induces 
an outer automorphism g dgO^^ of SOo(l, A^) (in the defining matrix representation). 
Then the mirror image T^e{s,i,) is defined by 7r5)(s ,t) ((yf) = 7is,^{0g9~^); the result mentioned 
is that 1^9(3,^) is unitary equivalent to H-s,^- 

An explicit formula for the value of the quadratic Casimir on any of these UIR (in terms 
of their parameters) is known j221 • 

As described in Appendix A.l the Cartan subgroups are relevant for the harmonic anal- 
ysis on G. In the case of G = SOo(l,A^), there is a single conjugacy class of Cartan 
subgroups when A^ is odd and two when A^ is even j^ZI, p. 188,212. In the notation 
of the previous section this arises because dim A = 1 in the Iwasawa decomposition 
G = KAN. In this case the number of conjugacy classes of G is 2'^^^^^~^^'^^'^^ . (Recall 
that rankSO(Ar) = [N/2], rankSO(l,N) =[(N+l)/2]). Exphcitly, if Hm is the (up to 
conjugacy unique) Cartan subalgebra of M one can adjoin either the generator of A or 
the generator of Hk/Hm (where Hk is the up to conjugacy unique Cartan subalgebra of 
K) in order to obtain an abelian subgroup of G. For A^ even both subgroups obtained in 
this way have the same dimension A^/2 = rankSO(A^) + 1. For A^ odd Hm and Hk have 
the same dimension y — 1 (a 2 x 2 block was needed to add a new Cartan generator). 
The compact abelian subalgebra H^ = Hk is thus not maximal and only the non- 
compact Cartan subalgebra exists. According to the general discussion the Plancherel 
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decomposition takes the form 

L2(SOo(l,iV)) = L2(SOo(l,iV))disc©0 / 



{0} N odd, 

L^(SOo(l,iV))disc = { (B.IO) 

e.edisc^'(SOo(l,iV)) AT even, 



where the sum in the discrete part ranges over the set in ()B.9|) . An exphcit formula for 
dfi{u,^) is known fI7\ . 

3. K-content of principal and discrete series: Restricted to the subgroup K = SO(A^) the 
irreducible representations of SOo(l, A^) decompose into a direct sum of irreducible 
representations r«; of K, each of which occurs with multiplicity at most one PU]- The 
subset of Kcr C K which occurs with nonzero (and hence unit) multiplicity is called the 
K content of the representation. Here we describe it explicitly for the principal and the 
discrete series. 



Recall from ()B.7j) that a principal series representation is labeled by a real parameter 
a; > and by a highest weight ^ of M = SO(A^ — 1). Explicitly the latter means 

iVeven : ^ = (6, • • • , ^Jv^) , < < • • • < ^Jv^ , 
iVodd : ^ = {^l,...,^N_^), |6l<6<---<eiv^- 

Here we used that UIR of the orthogonal groups are labeled by highest weights which are 
ordered sets (mi, . . . , m^), where r = rankSO(A^) equals N/2 and {N—l)/2 for N even 
and odd, respectively. The nii are either all integer or all halfinteger and are subject to 
the constraints 



S0(2r) : \mi\ < m2 < • • • < rrir 
S0(2r + 1) : <mi < . . . <mr. (B.12) 

The singlet corresponds to k = (0, . . . , 0); the symmetric traceless tensor representions 
have K = (0, . . . , 0, m^), m,. G N. The mirror image 6k of an UIR k is defined as follows. 
Let e e 0{N) be a reflection, i.e. 9^ = I, det^ = -1. Since OkQ-^ e SO{N) for all k, 
we can define a representation of SO(iV) by rQ^{k) := r^{6k6~^) called the mirror image 
of K. It is again an irreducible highest weight representation and unitarily equivalent to 
r^', where 

S0(2r) : k' = {—mi,m2, . . . ,mr) , 
S0(2r + 1) : k' = {mi,m2, . . . ,mr) = K . (B.13) 

The K = SO{N) content Tr^j^g can now be described explicitly 
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where each UIR of K occurs with multiphcity precisely one and the subsets d K are 
characterized by [101 HTj 

even : k = (mi, . . . , mjv) , \Tni\ < < m2 < . . . < < mN_ , 
N odd : K = (mi, . . . , ui n-i ) , Ki| ^ ""^i ^ ^2 ^ • • • ^ ^ iv-i < m iv-i . 

These are precisely the same conditions under which the UIR ^ of M = SO(A^— 1) occurs 
(with unit multiplicity) in the restriction of r^^^M (see e.g. jSI). The result ()B.11|) thus 
exemplifies the general reciprocity rule mentioned in part A: if 'Kuj£\k contains k, & K 
(with unit multiplicity) then t^Im contains ^ G M (with unit multiplicity). 

Since the last label m^, r = rankSO(A^), can be made arbitrarily large the subsets 
are always infinite. However with the exception of ^ = (the M-singlet) they never 
contain k = (the K singlet). The K content of vr^,5=o (the spherical principal series) 
is given by 

K^^Q = {{0,...,0,mr), mr>0}. (B.16) 

As can be seen from (IB.17jl below the discrete series representations never contain a 
K singlet. Irreducible representations containing a vector invariant under a compact 
subgroup are often called "class 1". One sees that among the representations of the 
restricted dual of SOo(l, A^) the only class 1 representations are those of the spherical 
principal series tt^^o, and for them the class 1 property with respect to M and with 
respect to K is equivalent. 

The K content of the discrete series (IB. 911 comes out as follows 



7r± 



(disc) : ±s < mi < ^1 < 11x2 < ■ ■ ■ < ^r-i < f^r , (B-17) 



either by direct investigation of the Harish- Chandra characters or by specialization 
of Blattner's formula [22 . One sees from ()B.13|) that a discrete series representation 
never contains some k, E K together with its mirror image 6k: mi is strictly positive for 
the Tr"*" series and strictly negative for the vr" series. Equivalently fl K^^- = 0. In 
particular the vr^ series never contain the K singlet. 

4- Harmonic analysis on M.^: Here we explicate the reduction of the harmonic analysis 
on L\SOo{l,N)) to that on ^^(Hjv), where Mn = SOo(l, Ar)/SO(iV), > 2, is the 
upper part of the two-sheeted hyperboloid in R^"*"^. The result will be the decomposition 
()A.26|) of the quasiregular representation £1 of SOo(l,iV) on Hat. Since K/M ^ S'^~^ 
all fiber spaces will be isometric to L'^{S^~^). The matrix elements ()A.23|) come out to 
be certain Legendre functions which are also generalized eigenfunctions of the Laplace- 
Beltrami operator on Hat. 

Let — A'^'^ be minus the Laplace-Beltrami operator on M.^. Its spectrum is absolutely 
continuous and is given by the interval ^{N—iy + 00"^, u > 0. There are several complete 
orthogonal systems of improper eigenfunctions. From a group theoretical viewpoint 



77 



the most convenient system are the 'principal plane waves' e^^^p{q) (see jHEj and the 
references therein) labeled by > and a 'momentum' vector p G S^~^. Parameterizing 
<? = - Is), they read 

^= - v^e^^-- pr^(^-i)— . (B.18) 



The completeness and orthogonality relations take the form 

c^7Q(?)e^,p(?)*ea;',p'(?) = d{ujY^5{u -uj')5{p,p) , 

poo p 

/ dud{uj) dS{p)e^,p{qre^,p{q') = 6iq,q'), (B.19) 

Jo 

where S{q,q') and S{p,jl) are the normalized delta distributions with respect to the 
invariant measures d'jQ^q) and dS{p) on Hat and S"^"^, respectively. In terms of the 
coordinates (^, s*) the former reads 

//•oo /» 
rf7Q(g) = / - If^'-' / dS{s) . (B.20) 

The spectral weight is determined by the Harish- Chandra c-f unction for SOo(l, A^) and 
is given by is 



d{Lj) 



(2vr; 



N 



T(iuj) 



(B.21) 



The main virtue of these functions is their simple transformation law under SOo(l,iV), 
see e.g. Appendix A of ^2]- It characterizes the spherical principal unitary series 
T<'uj,o, > 0, of SOo(l, A^), where vr^^o and its complex conjugate are unitary equivalent 
(see e.g. jSE], Sections 9.2.1 and 9.2.7). The orthogonality and completeness relations 
()B.19|1 amount to the decomposition ()A.26jl of the quasi-regular representation ii on 
L2(H^). 

Spectral projectors Ej commuting with ii are defined in terms of their kernels Ei{q ■ q'), 
/ C M+ by 

Ei{q-q'):= / dujd{uj) / dS{p) e^^p{qy e^^p{q') , 
Ji Js^-^ 

J dQ{q')Ej{q ■ q')Ej{q' ■ q") = Einj{q ■ q") . (B.22) 

Combined with the completeness relation in ()B.19|1 this shows that the spectrum of 
_^H]v jg absolutely continuous. 

A complete orthogonal set of real eigenfunctions of — Ae^ is obtained by taking the 
dS{p) average of the product of e^j.piq) with some spherical harmonics on the p-sphere. 
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This amounts to a decomposition in terms of SO^(A^) UIR where the 'radial' parts of 
the resulting eigenf unctions are given by Legendre functions. Using the normalization 
and the integral representation from ([20j p. 1000) one has in particular 

/ dSip) e^,M = {2nr'\e - ^ivZ'JO • (B.23) 

As a check on the normalizations one can take the ^ ^ l"*" limit in ()B.23|1 . The limit on 
the rhs is regular and gives 27r^/^/r(A^/2), which equals the area of S*^^^ as required 
by the limit of the Ihs. Denoting the set of real scalar spherical harmonics by Y£m{k), 
i eNo, m = 0,...,de-l, with = {2i + N - 2){k + N - 3)\/{i\{N - 2)!) we set 



Eu;,em{q) ■= J dS{p) Yim{p)eu;,p{q) (B.24a) 
= n,HF,^(.-')(e^- 1)1(2-^) with (B.24b) 



, £> 1. 



The expression ()B.24b ) is manifestly real, the equivalence to ()B.24b ) can be seen as 
follows: from ()B.19j) . ()B.20|1 . and the orthogonality and completeness of the spherical 
harmonics one readily verifies that both ()B.24b ) and ()B.24b ) satisfy 



POO 

/ dudico)J2E...imiqyE^.imiq') = Siq,q'). (B.25) 



Further both ()B.24b ) and ()B.24b ) transform irreducibly with respect to the real de 
dimensional matrix representation of SO^A^) carried by the spherical harmonics. Hence 
they must coincide. A drawback of the functions ()B.24|) is that the k integration spoils 
the simple transformation law of the e^^p under S0(1, A^). The transformation law can 
now be inferred from the addition theorem 

E E^,eME^Mq') = (2vr)^/2 [(g-g')^ - Ij^^^"^) V'sJ^^Jq-q') . (B.26) 

For example for q' = gq^ this describes the transformation of the S0\A^) singlet E^^ Qfiiq) 
under ^ G S0(1,A^). 



79 



Appendix C: The amenable case ISO(N) 

Here we outline counterparts of our main results for the coset space ISO(A^)/SO(A^) ~ 
M^. This coset can be viewed as the flat space limit of the hyperboloid SOo(l, A^)/SO(A^). 
The underlying Euclidean group ISO(iV) is noncompact but amenable; in accordance 
with the general picture 38j the generalized spin systems turn out to have a unique 
non-normalizable ground state. 

The group ISO(A^) is the semi-direct product of the amenable groups SO(A^) and M^, 
and hence is itself amenable, jHj, Lemma 18.3.7. As the defining representation one can 
take a subgroup of x matrices acting on vectors {x, 1)^ in M^"*"^ 

g{k,a)=(^^'^, ^,(A:,a)Q = (^'^ + ^), k e SO{N) , a,x eR'^ . (C.l) 

The composition law is g{ki,ai)g{k2,a2) = g{kik2,ai + kia2), which gives g{k,a)~^ = 
g{k~^ , —k^^a) and g{k, a) = g{e, a)g{k, 0) = g{k, 0)g{e, k~^a). Haar measure on ISO(A^) 
is dkda, where dk is the normalized Haar measure on SO(A^) and da Lebesgue measure 
on R^. 

We shall need a section gs : —>■ ISO(A^) such that x = gs{x)x\ where x^ = (0, 1)^ is 
fixed by the rotation subgroup. An obvious choice is 

^7s(x)=(q^), higik,a),x) = k-\ (C.2) 

for which the cocycle kg in ()2.12j) is independent of x and a. 

The configuration manifold is M = = R^'', the state space is L'^{M) = L'^iR'^"), 
and ISO(A^) acts on it via the u-fold inner product of the left quasiregular representation 
£i. Explicitly 

[iM{k,a)ip]{x) = ilj{k~^{x - a)) , x = {xi, . . . ,x^) , (C.3) 

where we wrote iM{k, a.) for ij^igik, a)). A transfer operator T in the sense of definition 
2.1 is described by a kernel T : M^'^ x R'^" R^, which is symmetric, continuous, 
pointwise strictly positive, and subject to the condition ()2.2|) . The invariance ij^ o T = 
T o iji^ translates into T{k{x + a), kijj + a)) = T{x, y), for all k G SO(A^) and a e M^. 
To exploit this symmetry we proceed as in Section 2 and switch to a model of L^(A^) 
where a^cts via right multiplication on a single group- valued argument. 

Recall that Air = {G x J\f)/d{K) and that the isometry to Ai is constructed from the 
map ^-.M^ ISO(A^) x TV, AT ^ R^('^-i) 

(i){xi,...,Xu) = {gs{xi)'^,X2 - Xi, . . . ,Xi, - Xi) , 

(j){g'^xi, . . . ,g~^Xu) = {gs{xiy^g,X2 - xi, . . . ,Xu - xi) . (C.4) 
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As expected the group acts on the image points by right multiphcation on the first 
argument. Since g{kQ,0)gs{xi)'^g{k,a) = gikok, — A;o(xi — a)) the left SO(A^) invariant 
functions on ISO(A^) x M are characterized by 

iprigsie, -k~^{xi - a)), k'^n) = i)r{g{k, -Xi + a),n) . (C.5) 

Effectively the functions ip^ thus project onto functions on Q x A/", however at the price of 
a more complicated group action. In fact ips^x^n) := ipr{g{e, —x),n) defines an element 
of L^(A^s) with the group action [£s{k,a)ips]{x,n) = ips{k~^{x — a), k~^n). 

The unitary irreducible representations (UIR) entering the decomposition of the regular 
representation of ISO(A^) on L^(ISO(A^)) can be described as follows (Gross and Kunze, 
|21j). For ^ u E let K^, be the isotropy group of u in K = SO(A^). Then each K^, is 
conjugate to M := SO^(A^ — 1), defined as the subgroup leaving ei = (1, 0, . . . , 0)"^ G 
invariant. Let m \—>- r^{m), ^ G M, be an irreducible representation of M on and 
consider (as in Eq. ()A.43j) ) 

LliK) = {fe L\K, V^) , f{mk) = r^{m)f{k) , m G M} , 
(/i,/2):= / dk{Mk)j2{k))v,. (C.6) 
On L'^{K) define a unitary representation by 

Kdko,ao)f]ik) = fikko). (C.7) 

This is well-defined because tTj.^^ commutes with the left regular representation of M. In 
particular [7rt,^^{ko,ao)f]{mk) = r^{m)[nu^^{ko,ao)f]{k). Moreover |2T| : 

- 7T,y^^ is irreducible for all 7^ z/ G and ^ G M. 

- Every infinite dimensional unitary representation is equivalent to some such tt^,^^. 

- Given 7^ z/, z/' G and C,, ^' G M, the representations 7r,y^^ and tt^'^^' are 
equivalent if and only if first u and u' belong to the same SO(A^) orbit and second 
^ and ^' are equivalent under the identification of Kj^ with K^i . 

These representations constitute the principal series of ISO(A^), the subset with ^ = 
(M-singlets) is called the spherical principal series. We now fix a representative from 
each equivalence class as follows. If z/ ■ z/ = z/' ■ z/' = a;^, G M+, then by abuse of 
notation we denote the A^-tuple (0, . . . ,0,u)'^ G also by uj. In this case we write 
= SO^(A^— 1) for and Tr^^^^ for n^^^. The K-content of these representations is the 
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same as that of the corresponding principal series representations of SOo(l, A^), as their 
restrictions to K coincide. This gives 



with K^C K as in (p?T5|) . 

The finite dimensional representations of ISO(N), obtained from the irreducible repre- 
sentations of SO(N) by representing the abelian normal subgroup of translations trivially 
are not in the support of the regular representation. 

So the Plancherel decomposition takes the form 

POO 

L2(IS0(iV)) = / 0dim\/5/:^,5®4|, 
Jo — 

POO 

px i = / dujd{uj) dimV^ Tr^,^ ® 7r^_| . (C.9) 



with 



(which can be viewed as the squared inverse of the Harish-Chandra c function for 
ISO(A^); see 1^2] for N = 2). The formulae for the harmonic analysis and synthesis 
will be given below. In relation to ()(I9|1 the singlet representation deserves special con- 
sideration. Since ISO(iV) is amenable the singlet must weakly be contained in (equiv- 
alently: lie in the support of) the regular representation (see e.g. jH], Prop. 18. 3. 6; and 
Definitions 18.3.1, 18.1.7). By definition this support is the restricted dual of the locally 
compact group under consideration, here ISO(A^). As a matter of fact [0], 18.8.4, it 
also coincides with the carrier of the Plancherel measure. The upshot is that the limit 
lim^^o '^ui,^=o is weakly contained in the decomposition ()C.9|1 and coincides with the 
singlet representation of ISO(A^). We shall write ttoo for it. 

To every G L^(1S0(A^)) one can asign a compact operator as its Fourier transform 



0(^^)0^ = j dkda(j){k,a) TXi,^^{k,a) = Tiu,i{4>) , (C-H) 

and for G {L} fl L^)(ISO(A^)) the image is a Hilbert-Schmidt operator for almost all 
(a;,^) with respect to the Plancherel measure. Since the latter is for fixed ^ absolutely 
continuous with respect to Lebesgue measure on M+, the Hilbert-Schmidt property will 
hold for almost all a; > with respect to the Lebesgue measure. Indeed, 7rt^,^(0) can be 
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realized explicitly as an integral operator on L'^{K). Repeating the steps in Appendix 
A. 8 one finds 

7r^,^(0)(A;,A;') = [ dmda(l){k-^mk',a)e''' ''\^{m) . (C.12) 
The formula for the Fourier synthesis reads 

POO 

(j){k,a)= I dcu d{uj) dim Tr[0(u;, ^)7Cuj,({k, a)] . (C.13) 
Jo -~ 

Formally this can be verified by evaluating the trace in terms of a kernel of the form 
()C.12|) and freely exchanging the order of integrations. For a proof see 



With these preparations at hand we can proceed with the group theoretical decompo- 
sition of the Hilbert space L'^{Air) and of standard invariant selfadjoint operators A 
acting on it. The constructions of Sections 2 and 3 carry over with minor modifications; 
mainly to fix the notations we run through the main steps. Proposition 2.2 remains 
valid with the Plancherel measure from ()(I9jl substituted and with the /^-content from 
()(18|1 . We use pairs cr = (uj,^) and a = (cu,^) to label the representations and their 
conjugates. Proposition 3.4 likewise carries over and provides the decomposition of the 
operators. We write 

POO 

L^{Mr) = / duj d{iu) ^ dimV^ Cl^iMr) , 
Jo — 

POO 

A = / rfturf(cu) dim\4 (I® A^l) , (C.14) 
Jo — 



-•2 



for the respective decompositions. The fiber spaces Cl^^{A4r) are isometric to ® 
C^^ ® L'^{Af) and I ® A^| acts for almost all > as a bounded linear and selfadjoint 
operator on these fiber spaces. 

The spectral problems of A and A^^ can now be related as in Sections 3.3 and 3.4. 
We maintain the definitions of the generalized eigenspaces Sx^^^{A) and £x{-Alu(), in 
Eqs. 1)3.411) and ()3.6H) . respectively. Then the map 

-,,^^{f){k,a,n)= I dk'f{n,k'y[7r^^{k,a)v]{k'), v e Ll{K) , (C.15) 



T, 



IK 



again provides an isometry onto its image. In the second line we used the realization of 
as Ljl^K) in ()('.6jl. The intertwining properties T^,ui{f){ggo, n) = T^^i.{9o)v,u;df)i9, n) 
and Ar^,^g(/) /) remain valid. Then Propositions EIEl and EiHl carry over. 
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Major modifications however occur in the structure of the ground state sector of a 
transfer operator T. Its fiber operators T^^ can be realized as integral operators on 
with the following kernel 

%^{n,n';k,k') = I dmdaT{k-^mk' ,a,n' ,n) e''^^'-''\^{m) . (C.16) 

For these integral operators a counterpart of Proposition 4.1 holds: the operators T^^ : 
L'^{N') — > L'^{J\f) are bounded for all (not almost all) on > 0, ^ G M. Their norms are 
continuous functions of lu and obey 

llT^dl < II Too II for all ^ G M, > 0, (C.17) 

where the inequality is strict unless ^ = and u; = 0. Further Tqo is a transfer operator 
in the sense of Definition 2.1. 

This result entails that all the generalized eigenspaces £||t||(T^^), uj > 0, & M, must 
be empty. The remaining £^||t||(Too) coincides with the ground state sector ^(Tqo) of 
Too- Provided the map ()C.15|) is defined also for u; = 0, ^ = it asigns to every gener- 
ahzed ground state / G ^(Too) a generalized ground state Xi,,oo(/) of T. Moreover by 
forming linear combinations J2i'^Vi,oo{fi) one can generate a dense set in ^(T). Since 
the singlet representation vtoo is one-dimensional, while all the vr^j^, u > 0, are infinite 
dimensional, the family of maps r^^^^o is of course not continuous for u ^ 0. However 
from ()C.16|) one can verify directly that every eigenfunction of Tqo, viewed as a function 
on G/K X J\f/dj^{K) constant in the first argument, is also a generalized eigenfunc- 
tion of T. Indeed the counterpart of ()(I15|1 for the singlet representation is simply 
''"oo(/)(e, ri) := Jdk f{n,k)*, as the function v is constant and can be omitted. Then 
[Troo(/)](e, n) = Too (Tqo/) (e, n), where the relevant kernel JdkdaT{k,a,n,n') is sym- 
metric in n and n'. It follows that linear combinations ^jCiroo(/i), Q G C, generate a 
dense subspace of ^(T). In particular all generalized ground states of T are functions 
on G/K X Af/dj\f{K) constant in the first argument. This means Too : ^(Too) 
is an isometry. Whenever ||T|| is an eigenvalue of Too both ^(Tqo) and ^(T) are one- 
dimensional. Viewed as an element of ^(T) however the wave function is not normaliz- 
able as the infinite volume of ISO(A^) is overcounted. In summary, we arrive at 

Theorem C.l Let T be a transfer operator on L'^{M.^'') commuting with the unitary 
representation ()C.3|) of ISO(A^). Let ^^^(T) denote the space of generalized ground 
states whose elements transform equivariantly according to vr^^g, > 0, ^ G SO(A^ — 1), 
and let I T^| be the component of T in the fiber vr^^. Then: 

(a) Q:^^(T) is empty unless u = 0, C, = 0, where ttoq is the singlet representation. 

(b) ^(T) can isometrically be identified with ^(Too) and is generated by rotationally 
invariant functions of 2:2 — Xi, . . . , — Xi. Whenever ||T|| is an eigenvalue of Tqo 
the transfer operator T has a unique ground state, which is up to a phase an 
a.e. strictly positive function of the above type. 
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